The advanced voice mode of the OpenAI macOS application has received a major update. The editor of Downcodes will take you to learn the details! The core of this update is the new image upload function. Users can now upload images through the voice interface and display them on the interface, which improves the intuitiveness of human-computer interaction. The implementation of this function makes users' interaction with ChatGPT more convenient and allows them to discuss pictures more easily.
Recently, OpenAI launched a new image upload feature in a major update to its macOS app’s Advanced Speech Mode interface. Previously, this function was not clickable, but now users can finally upload images through the voice UI, and the uploaded images will be displayed on the interface.
However, it's worth noting that ChatGPT doesn't prompt users that it can't see the uploaded image. Users can upload a picture and have related discussions with ChatGPT, and everything becomes more intuitive.
In addition to uploading images, users can also take photos directly using their laptop's camera, allowing them to instantly share what they capture. However, there are currently no screen sharing, camera sharing, and video sharing features, which are still pending.
In this update, there are also minor adjustments to how some messages are displayed. For example, the interface has also been revamped with tips on how to start a new chat to use advanced voice mode. It is worth mentioning that if the user is behind a session involving video sharing, ChatGPT may prompt the user to explicitly share the video to help improve the model. This prompt appears when the user has enabled the option to share video data for model training. However, this option is currently not live in the UI and may be released together with the screen and video sharing features.
This update may herald the future launch of the Canvas editor, a feature that was previously spotted in development. Next, the full rollout of voice mode may take longer, unless OpenAI decides to launch it first, regardless of video and screen sharing capabilities.
In addition to image uploading, the update also includes interface tweaks and hints at potential future features, such as a Canvas editor and a more comprehensive voice mode. However, functions such as screen sharing are still under development, and we look forward to more surprises in subsequent updates of OpenAI.