OpenAI on Thursday said it has updated its ChatGPT desktop app to add support for ChatGPT Voice, allowing users to talk to the app to control AI agents and perform tasks on their computer.
The new feature taps OpenAI’s new family of voice models called ChatGPT-Live, which it launched earlier this month.
OpenAI said ChatGPT Voice works with both ChatGPT Work and Codex, and can also tap computer use skills to look up websites and apps. Plus, on macOS, with Appshots, users can let the app access what’s on their screen, including alt-text.
At launch, ChatGPT Voice’s smartphone version featured smoother conversations, with better interruption handling, but it was not built to take action on smartphones.
Thursday’s desktop update is more capable, allowing users to dictate complex commands involving many steps, and respond when ChatGPT needs their input.
In a demo video, OpenAI showed a developer asking ChatGPT to create a new thread, make a pull request, and find the root cause for a bug, with one command.
The company said that users can utilize ChatGPT Voice in Codex from the iOS app through remote access.
Anthropic has also updated its voice mode for Claude, which can tap the company’s Opus, Sonnet and Haiku models to complete tasks in apps like Gmail, Calendar, Slack, Notion, and Canva.
Leave a comment