AI Video

Top AI researchers look beyond LLMs

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

3 min read

Best AI researchers compared

The Race to Build 'World Models'

Top AI researchers look beyond LLMs - Video
YouTube Video

"We're moving beyond LLMs to build something far more powerful: reality-simulating 'world models'." This statement, central to the discussion on CNBC's Tech Check, encapsulates a significant shift in artificial intelligence research. The segment featured Deirdre Bosa interviewing experts about the development of AI that doesn't just process language but understands and simulates the physical world. This new frontier, termed "world models," is poised to redefine AI capabilities, moving past the limitations of current large language models.

The discussion highlighted a race among major tech players to develop these sophisticated AI systems. Companies like Google, Tencent, Nvidia, and World Labs are investing heavily in this area. The underlying principle is to equip AI with a deeper understanding of spatial intelligence, enabling it to comprehend not just what things look like, but how they interact and behave within a given environment. This is a departure from traditional LLMs, which are primarily trained on vast amounts of text data to predict the next word in a sequence.

A key insight presented is that world models learn the "laws of physics" within their simulated environments. Unlike LLMs that act as students who have memorized every answer ever written, world models are designed to understand underlying principles. This allows them to predict outcomes in novel situations, a capability crucial for more advanced AI applications.

The video demonstrated this with an example from World Labs' "Marble" product. By inputting a single 2D photo of CNBC's global headquarters, the AI was able to generate an interactive 3D model of the space. This model wasn't just a static representation; it allowed users to navigate through the environment, change perspectives, and even simulate how light and objects would behave. This ability to understand and replicate physical properties, like gravity, is a significant leap forward.

This advancement has profound implications across various industries. For instance, in real estate, agents could use world models to offer immersive virtual tours of properties, allowing potential buyers to explore spaces remotely with a sense of depth and realism. Interior designers could create and test different design schemes in a simulated environment before implementation. Manufacturing could benefit from AI that can accurately predict how materials will behave under stress or how complex machinery will operate.

The distinction between LLMs and world models is crucial. While LLMs excel at generating human-like text and understanding linguistic nuances, they often lack a grounded understanding of the physical world. World models, conversely, are built to grasp causality, spatial relationships, and physical interactions. As one expert pointed out, "An LLM is like a student that memorizes every answer ever written. World models, they actually learn the law of physics." This learned understanding allows them to generalize and predict, offering a more robust form of intelligence.

The development of these world models signifies a paradigm shift. Instead of relying solely on massive datasets and brute-force computational power, the focus is shifting towards AI that can learn and reason about the world in a more intuitive, human-like manner. This evolution promises to unlock new applications and capabilities that were previously unimaginable, moving AI from a tool of information processing to one of environmental understanding and interaction. The potential for this technology to revolutionize fields from robotics to scientific simulation is immense.

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsAIArtificial IntelligenceTechnologyTop AI researchers

StartupHub.ai StaffDaniel SingerWritten by StartupHub.ai Staff, Editorial teamReviewed by Daniel Singer, EditorAbout

StartupHub.ai Staff, Editorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer, Editor

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

More from Daniel Singer

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.