Listen and subscribe to Opening Bid on Apple Podcasts, Spotify, Amazon Music, YouTube or wherever you find your favorite podcasts.
The next big breakthrough in AI could be one that channels the spirit of famed scientist Albert Einstein.
“The problem is that large language models [LLMs] make mistakes. And they’re always going to make mistakes, but they’re going to make fewer and fewer. At some point, they’ll make so few mistakes you can use it in medicine, you can use it in law,” Groq founder and CEO Jonathan Ross said on Yahoo Finance’s Opening Bid podcast (watch above; listen-only below).
Ross said the ability of AI models to invent is among the next wave coming, and it’s likely to happen within his lifetime. Currently, LLMs tend to pick the most probable answer to questions, which precludes them from discovering something new.
“And if it’s the most obvious, it’s not going to be good writing. It’s not going to be good science. It’s not going to invent something for you. It’s not going to invent a drug that isn’t known. That’s what we’re working on next. Invention is next,” Ross explained.
While at Google (GOOG, GOOGL), Ross designed the custom chips that the tech giant would go on to use for training its AI models.
Today, Ross has a ground-floor view into how LLMs are likely to continue to evolve in the years ahead.
Groq makes what it calls language processing units (LPUs). These LPUs are designed to make large language models run faster and more efficiently than Nvidia’s (NVDA) GPUs, which target training LLMs.
By making them run faster and more efficiently, Groq’s chips can help LLMs on their road to becoming inventive rather than just using reasoning, as ChatGPT and other chatbots do today.
Groq’s last capital raise came in August 2024, when it raised $640 million from companies including BlackRock (BLK) and Cisco (CSCO).
The company’s valuation at the time stood at $2.8 billion, a fraction of Nvidia’s more than $3 trillion market cap. It currently clocks in at $3.5 billion, according to Yahoo Finance’s private markets data.
Three times each week, Yahoo Finance Executive Editor Brian Sozzi fields insight-filled conversations and chats with the biggest names in business and markets on Opening Bid. You can find more episodes on our video hub or watch on your preferred streaming service.
Brian Sozzi is Yahoo Finance’s Executive Editor. Follow Sozzi on X @BrianSozzi, Instagram, and LinkedIn. Tips on stories? Email brian.sozzi@yahoofinance.com.
