“This is the first time we're really taking a giant step forward when it comes to ease of use,” Murthy said.
OpenAI, backed by Microsoft, is valued at more than $80 billion by investors. The company, founded in 2015, is under pressure to stay on top of the creative AI market while finding ways to make money as it spends heavily on processors and infrastructure to build and train its models.
The o in GPT-4o stands for omni. Murthy said the new model allows ChatGPT to handle 50 different languages with better speed and quality, and will also be available through OpenAI's API so developers can start building applications using the new model today. .
He added that the GPT-4o is twice as fast, and half the price of the GPT-4 Turbo.
Members of the OpenAI team demonstrated the new model's audio capabilities, asking for help calming down before public speaking. OpenAI researcher Mark Chen said the model has the ability to “understand your emotions”, adding that the model can also handle users interrupting it. The team also asked it to analyze the user's facial expressions to comment on the emotions the person was experiencing.
“Hey there, what's up? How can I brighten your day?” ChatGPT's audio mod said when a user greeted him.
According to a blog post, the company plans to test Voice Mode in the coming weeks, with early access for paid ChatGPT Plus users. OpenAI also said the new model can respond to users' audio prompts “in 232 milliseconds, with an average of 320 milliseconds, which is similar to human response time in conversation.”
Chen demonstrated the model's ability to tell a bedtime story and asked her to make her tone of voice more dramatic or robotic. He even asked her to sing the story.
The new OpenAI model can also act as a translator, even in audio mode, the company said. Chen demonstrated Toll's ability to listen to the Italian-speaking Moratti as he spoke English and translate them into their respective languages as they conversed.
Team members also demonstrated the model's ability to solve mathematical equations and help write code, positioning it as a strong competitor to Microsoft's own GitHub Copilot.
For OpenAI, this is one of the company's biggest announcements since the August launch of ChatGPT Enterprise, a business-grade AI chatbot. OpenAI COO Brad Lightcap told CNBC at the time that the tool had been in development for “less than a year” and was supported by more than 20 companies of various sizes and industries.
OpenAI, Microsoft and Google are leading a generative AI gold rush as companies in seemingly every industry race to add AI-powered chatbots and agents to key services to avoid falling behind rivals. Earlier this month, OpenAI competitor Anthropic announced its first enterprise offering and a free iPhone app.
According to Pitchbook, a record $29.1 billion was invested in nearly 700 generative AI deals in 2023, up 260 percent from last year. The market is predicted to top $1 trillion in revenue within a decade.
Some in the industry have expressed concern about the speed at which untested new services are coming to market, and academics and ethicists worry about the technology's tendency to spread bias.
After ChatGPT launched in November 2022, it broke records at the time as the fastest-growing consumer app in history, and now has nearly 100 million weekly active users. OpenAI says more than 92% of Fortune 500 companies are using the platform.
OpenAI “wants to take some of the mysticism out of the technology,” Moorthy said during Monday's event.
“Over the next few weeks, we'll roll out these capabilities to everyone,” Murthy said.
A blog post on Monday said the new model will be rolled out to ChatGPT Plus and Team users first on Tuesday, and then to Enterprise later. It will also be available to free users of ChatGPT from Monday, with limited usage. ChatGPT Plus users will have five times the message capacity of free users, and even higher usage limits for ChatGPT team and enterprise clients.
Murthy concluded the live-streamed event by thanking Nvidia CEO Jensen Huang and his company for providing the necessary graphics processing units (GPUs) to power OpenAI's technology.
“I just want to thank the incredible OpenAI team, and also Jensen and the Nvidia team for bringing us the latest GPUs to make today's demo possible,” she said.
Watch: OpenAI's Google Search competitor