[ad_1]
OpenAI, the developer behind one of the most popular AI chatbots that helps users generate content using natural language prompts, has announced its latest update: ChatGPT. This new chatbot version allows users to communicate using voice commands, providing replies and offering a transcription of the voice chat. Users can now receive images and voice input and make voice calls, making ChatGPT more versatile and interactive as an AI assistant.
ChatGPT is a language model-based chatbot that supports users using professional voice actors and OpenAI’s text-to-speech model. Some users have also started using ChatGPT as a voice assistant, similar to Siri, by assigning the ChatGPT voice shortcut as an action button. This allows users to customize and perform various tasks, such as launching apps or running shortcuts, to more naturally access ChatGPT on their iPhones.
ChatGPT voting feature
This feature is now available to everyone for free. It offers a variety of five different voices and allows users to voice their requests instead of typing them. Under the hood, it uses the Whisper AI model to convert voice into text. Initially this feature was exclusive to ChatGPT Plus, but is now available to everyone for free. It can be accessed on mobile devices on both Android and iOS, allowing quick access to ChatGPT and more seamless interactions.
ChatGPT with voice is now available to all free users. Download the app on your phone and tap the headphones icon to start a call.
Sound on 🔊 pic.twitter.com/c5sCFDAWU6— OpenAI (@OpenAI) November 21, 2023
You can start a voice conversation in chat using vision capabilities similar to what you are used to when starting a voice conversation in a conversation using GPT AI models. This allows users to communicate via voice conversations to enhance the AI’s capabilities, making interactions more natural and dynamic. Furthermore, this feature uses professional voices and OpenAI’s text-to-speech model to provide a more natural and interactive user experience.
Use ChatGPT voice chat
- Start by downloading the ChatGPT app on Android via the Play Store and on iOS via the App Store on your smartphone.
- Then sign in with your OpenAI account to access the voice chat feature on ChatGPT.
- Then you can have a back-and-forth conversation with ChatGPT. Speak your command out loud and when you’re done speaking, tap the area that says “Tap to stop recording.”
- On the ChatGPT homepage, tap the headset icon in the bottom right corner of the text area to start voice chat.
- Start talking now to chat with your voice using ChatGPT. It answers your questions and actively listens to your voice.
You can customize ChatGPT voice chat by changing the preferred voice from five different options. This way you can use the ChatGPT Voice function in ChatGPT, similar to Google Assistant or Siri.
Voice and image capabilities
The new conversational AI assistant can now communicate with users via voice and images. Users can now make voice conversations or show ChatGPT images to discuss landmarks, food or math problems. You can start using Speech and Vision by opting for voice calls in the mobile app settings and choosing from different synthetic voices.
You can capture images and use drawing tools to focus on specific parts. Voice and visuals are available on all platforms for Plus and Enterprise users. The text-to-speech models can generate realistic audio from text and sample speech, powered by multimodal GPT 3.5 and GPT-4. These models can analyze various images, including photos, screenshots, and documents. ChatGPT is facing competition from other voice assistants, such as Amazon’s Alexa, which recently announced a new LLM that would give it ChatGPT-like capabilities.
There was a lot of drama at OpenAI recently when it was announced that the board of directors had fired CEO and co-founder Sam Altman for unclear reasons. This resulted in more than 500 employees threatening to resign, resulting in Altman being reinstated as CEO and most of the board members replaced.
Finally, these capabilities introduce new risks such as impersonation, fraud, privacy and accuracy. OpenAI’s ChatGPT has taken steps to mitigate these risks, such as collaborating with voice actors and limiting the model’s ability to analyze and make direct statements about people. Users are advised to verify the content generated by the model and not to use it in high-stakes domains.