Subscribe to our daily and weekly newsletters to receive the latest updates and exclusive content on industry-leading AI reporting. Learn more
OpenAI has expanded the number of applications its desktop apps can work with, including the ability to use Enhanced Voice Mode with other apps, and is moving closer to ChatGPT when used on computers.
The desktop app has been launched Integrations in November with initially four applications. On day 11 of its 12 Days of OpenAI event, OpenAI announced several new integrated development environments (IDEs), terminals and text apps that it will support.
ChatGPT now supports BBEdit, MatLab, Nova, Script Editor, TextMate as IDEs, VS Code for VSCode Insider, VSCodium, Cursor, WindSurf, Android Studio’s JetBrains IDE family, AppCode, CLion, DataGrip, GoLand, IntelliJ IDEA, PHPStorm , PyCharm, RubyMine, RustRover and WebStorm. Additionally, the Warp and Prompt terminal apps have been added as integrations. These applications complement VS Code, Xcode, Terminal, iTerm 2 and TextEdit as integrated apps.
But coding applications won’t be the only applications ChatGPT desktop apps can access. OpenAI has also added Apple Notes, Notion, and Quip to its integrations. Advanced Language Mode can work with these applications while taking into account the context of the projects in the integrations.
OpenAI emphasized that users must give ChatGPT permission to access these applications.
Let ChatGPT use your computer for you
Of course, app integrations with AI chatbots are nothing new. In October, GitHub Added copilot Coding platform integrations. Connecting applications to ChatGPT or Copilot integrates the context of these platforms into the chat experience. Developers can ask ChatGPT for coding help on a project they have in VS Code and the chatbot will understand what they have been working on.
Kevin Weil, chief product officer at OpenAI, said during a livestream that improving the desktop app will help the company move closer to an agent user experience for ChatGPT.
“We put a lot of effort into our desktop apps,” Weil said. “As our models become more powerful, ChatGPT becomes more of an agent. This means we go beyond just questions and answers. ChatGPT will start doing things for you.”
He added that desktop apps represent “a big part” of that transformation.
“As a desktop app, you can do a lot more than just a browser tab,” he said. “This includes things like the ability to see what’s on your screen with your permission and the ability to automate much of the work you do on your desktop. We will have much more to say about this in 2025.”
If OpenAI lets ChatGPT see more of your computer, ChatGPT gets closer to Anthropic’s Claude Computer use Feature that allows Claude to click around on a person’s computer, navigate screens, and even enter text.
OpenAI has already announced a fair one similar function for mobile phones version of ChatGPT, although the chatbot cannot yet access computers or phones in the same way. Users can share their screens with the chatbot so that it can “see” what they are reading or watching. Microsoft And Google also developed comparable functions Copilot vision And Project Astra.
Here’s how to access it
On macOS, users who want to open ChatGPT while using other applications can use “Option + Space” to bring up ChatGPT and select the desired application using a button on the chat screen. Another keyboard shortcut, “Option + Shift + 1,” brings up the top application in use.
From this window, users can also access Advanced Voice Mode in the same way. Voice mode automatically detects the context of the application.
Integrations are available to ChatGPT Plus, Pro, Team, Enterprise, and Edu users. However, Enterprise and Edu subscribers will need to ask their IT administrators to enable the feature.
Source link
