[fb-exchange] Re: CHAT GPT is now able to 'see, hear and speak'

  • From: Adrian Talpa <hello@xxxxxxxxxxxxxx>
  • To: fb-exchange@xxxxxxxxxxxxx
  • Date: Wed, 27 Sep 2023 15:54:52 +0000

I only tested its "speaking" capabilities and it's mindblowing. I think it's the same female voice speaking in Be My A.I. when describes the photos.


-Adrian

On 2023-09-27 15:54, Tony Sweeney wrote:

CHAT GPT is now able to 'see, hear and speak'
VISHWAM SANKARAN


ChatGPT has a new upgrade that lets the viral artificial intelligence tool "see, hear and speak", according to OpenAI.
The update for OpenAI's artificial intelligence chatbot will allow users to have voice conversations with the AI chatbot and interact with it using images as well, the firm said in a blog post yesterday.
"ChatGPT can now see, hear and speak," the firm also said in a post on X, formerly Twitter.
The features will be rolled out "over the next two weeks" and enable users to "use voice to engage in a back-and-forth conversation" with the AI assistant.
With the new features, ChatGPT can be used to "request a bedtime story for your family, or settle a dinner table debate", according to the company, bringing it closer to the services offered by Amazon's Alexa or Apple's Siri AI assistants.
Providing an example of how the feature works, OpenAI shared a demo in which a user asks ChatGPT to come up with a story about "the super-duper sunflower hedgehog named Larry".
The chatbot replies to the query with a human-like voice and also responds to questions such as "What was his house like?" and "Who is his best friend?".
OpenAI said the voice capability is powered by a new text-to-speech model that generates human-like audio from just text and a few seconds of sample speech.
"We collaborated with professional voice actors to create each of the voices. We also use Whisper, our open-source speech recognition system, to transcribe your spoken words into text," the company said.
The AI firm believes the new voice technology is capable of crafting realistic-sounding synthetic voices from just a few seconds of real speech, and could open doors to many creative applications.
However, the company also cautioned that the new capabilities may also present new risks "such as the potential for malicious actors to impersonate public figures or commit fraud".
Another major update to the AI chatbot allows users to upload an image and ask ChatGPT about it.
"Troubleshoot why your grill won't start, explore the contents of your fridge to plan a meal, or analyse a complex graph for work-related data," OpenAI suggested.
This new feature, according to the company, also lets users focus on a specific part of the image using a drawing tool in the ChatGPT mobile app.
This kind of multimodal recognition by the chatbot has been forecast for a while, and its new understanding of images is powered by multimodal GPT-3.5 and GPT-4.
These models can apply their language reasoning skills to a range of images, including photographs, screenshots and documents. (© Independent News Service)
Irish Independent Technology

=========================================================== The fb-exchange mailing list Manage account, List Page: https://www.freelists.org/list/fb-exchange
Archive: https://www.freelists.org/archive/fb-exchange
To unsubscribe: log onto the List page and select "Unsubscribe".

Administrative contact: insight@xxxxxxxxxxxxxxxxxxxx

===========================================================
=========================================================== The fb-exchange mailing list Manage account, List Page: https://www.freelists.org/list/fb-exchange
Archive: https://www.freelists.org/archive/fb-exchange
To unsubscribe: log onto the List page and select "Unsubscribe".

Administrative contact: insight@xxxxxxxxxxxxxxxxxxxx

===========================================================

Other related posts: