Elon Musk’s AI chatbot can now “understand” images, including information-rich diagrams and charts. Sorry, doesn’t everyone use the platform that was once called Twitter to do multidisciplinary research and improve their workflow?
Introduced as the Grok-1.5V — or Grok 1.5 “Vision,” the company’s “first-generation multimodal model” — the bot will be able to respond not only to images and screenshots you upload, but also to complex documents, Will also be able to argue through scientific diagrams, charts. Screenshots and images, the company says. Additionally, the Grok-1.5V will gain “real-world spatial understanding” to better understand the physical world depicted in images uploaded by its users.
“Advancing both our multimodal understanding and generation capabilities are important steps in building beneficial AGI that can understand the universe,” the company wrote in its announcement. “In the coming months, we expect to make significant improvements to both capabilities in various modes such as photos, audio and video.”
If you’re a paying X user, Elon Musk wants his Grok AI to write your posts for you, the report says.
Examples of use cases include translating a diagram into Python code, turning a child’s drawing into a bedroom story, identifying the largest object in a group of many people, and telling a driver if they has enough room to drive around an obstacle.
The Grok-1.5V is released with xAI’s RealWorldQA, an image and instant data set designed to test other GenAI models against Grok’s real-world reasoning.
The tweet may have been deleted.
However, competition is the least of Grok’s worries. Despite xAI’s continued investment, Grok has yet to stick with early users and staff — a new report alleges that its own developers are struggling to use the slow xAI API. The same report was published. good fortune This week highlighted X-employee’s concerns about Musk suggesting Grok write paid user posts for them despite warnings from developers and staff. Last week, Grok came under fire for creating fake news headlines from an alternate reality where Iran attacked Tel Aviv with military weapons — not the first time.
Although GenAI chatbots distort facts and generate fake news, Grok’s gaffe points to a wider problem with the site. The bot, Musk’s par for the course answer to ChatGPT, is integrating into a platform that is slowly eroding its defenses against AI. Combined with X’s all-around bad reputation for moderation and the CEO’s own refusal to tackle misinformation in support of the site’s “citizen journalists,” Grok occupies a precarious position in the platform’s beleaguered information ecosystem. Is.
The Grok-1.5V will soon be available to early testers and select customers.