Artificial Intelligence

Lemon Slice Aims to Break Avatar Turing Test

Lemon Slice's CTO, Sydney Primas, discusses their mission to create AI avatars indistinguishable from humans, showcasing recent advancements and future plans for emotional intelligence in AI.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

4 min read

Screenshot of a presentation slide showing an AI avatar and company logo.
Credit: AI Engineer
Visual TL;DR
Sydney Primas CTOCore
Lemon Slice CTO discusses mission, advancements, and future plans for AI emotional intelligence
From the articleSydney Primas, CTO and founder of Lemon Slice, shared the company's mission to "break the Avatar Turing test", creating AI avatars that are indistinguishable from humans on video calls.
Break Avatar Turing TestDriver
From the article 3 mentionsSydney Primas, CTO and founder of Lemon Slice, shared the company's mission to "break the Avatar Turing test", creating AI avatars that are indistinguishable from humans on video calls.
Complex Technical ChallengesDriver
From the articleThis involves not only photorealism but also tackling complex technical challenges such as accurate emotions, object interactions, micro-expressions, and creating an internal state that makes avatars feel like real beings.
Microsoft PartnershipCore
From the articlePrimas highlighted a significant recent achievement: a partnership with Microsoft to create an AI avatar of Theodore Roosevelt for his presidential library.
Roosevelt Avatar InteractionEffect
From the article 5 mentionsWithin a replica of the Oval Office, visitors can interact with the Roosevelt avatar in real-time.
World Model ApproachContext
a key technical strategy for creating realistic and interactive AI avatars
From the articleLemon Slice's technical strategy centers on a distinct approach: focusing "world models" on humans.
Major MilestoneOutcome
former President Trump interacted with the Roosevelt avatar, extending his visit
From the articleWhile acknowledging that the "Turing test is not solved yet," Primas presented this as a major milestone.
Future EQ LayerEffect
plans for an 'EQ Layer' to enhance emotional intelligence in AI avatars
From the article 5 mentionsLooking ahead, Primas expressed his strong belief that a single model will emerge as the "EQ layer" for AI.
Contents(5)

Sydney Primas, CTO and founder of Lemon Slice, shared the company's mission to "break the Avatar Turing test", creating AI avatars that are indistinguishable from humans on video calls. This involves not only photorealism but also tackling complex technical challenges such as accurate emotions, object interactions, micro-expressions, and creating an internal state that makes avatars feel like real beings.

Lemon Slice Aims to Break Avatar Turing Test - AI Engineer
Lemon Slice Aims to Break Avatar Turing Test, AI Engineer

Bringing History to Life with Microsoft Partnership

Primas highlighted a significant recent achievement: a partnership with Microsoft to create an AI avatar of Theodore Roosevelt for his presidential library. Within a replica of the Oval Office, visitors can interact with the Roosevelt avatar in real-time. While acknowledging that the "Turing test is not solved yet," Primas presented this as a major milestone. Notably, former President Trump attended the opening and interacted with the Roosevelt avatar, even extending his visit to continue the conversation.

The "World Model" Approach to Avatar Creation

Lemon Slice's technical strategy centers on a distinct approach: focusing "world models" on humans. Primas explained that while this method is more challenging initially in terms of training and deployment, it yields significant benefits. Once a model is established, it naturally handles complex aspects like full-body movement, object interaction, scene dynamics, and even subtle micro-expressions and emotions. These capabilities, he noted, come "more for free" compared to other methods.

Key Technical Hurdles and Solutions

Primas detailed several hard technical problems Lemon Slice is tackling:

  • Audio-driven Realism: The importance of high-quality audio data for training expressive models was emphasized. Unlike standard audio encoders trained on monotone audiobooks, Lemon Slice focuses on expressive audio to ensure video models are equally capable of conveying emotion.
  • Real-time Interactivity: Video models typically look into both the past and future. For real-time interaction, Lemon Slice trains models with an attention mask that restricts them to only looking at the past, ensuring they react to current inputs rather than predicting non-existent futures.
  • Performance Optimization: Reducing the numerous denoising steps required for video generation (e.g., from 30 steps down to one) is crucial for real-time performance.
  • Error Accumulation: A significant challenge in real-time video generation is the compounding of errors over time. Lemon Slice has developed a new method to address this, enabling continuous, long-duration avatar generation with no noticeable error accumulation.
  • Hardware Optimization and Cost-Effectiveness: Making the technology affordable for widespread use is a priority. Lemon Slice has achieved this by making models efficient enough that the costs are comparable to voice models, despite the higher data demands of video.
  • Model Harness: This refers to the complex orchestration of real-time data streaming across CPU and GPU, managing interrupts, queues, and buffering to ensure seamless, stutter-free video generation. Primas believes this aspect holds significant future value.

The Future: An "EQ Layer" for AI

Looking ahead, Primas expressed his strong belief that a single model will emerge as the "EQ layer" for AI. This model would directly process user video and audio, generate speech, manage internal emotional states, and produce the avatar's output video and audio. While this EQ model would excel at emotional intelligence and human interaction, it would be complemented by a separate "IQ" model responsible for complex reasoning, tool-calling, and other intelligent AI functions. He predicts such end-to-end EQ models will be on the market within two to three years.

Addressing Key Questions

During the Q&A, Primas discussed the nature of the avatars' internal states, suggesting they would be implicit and not necessarily human-interpretable. He also clarified that while the company is developing its own Turing test for avatars, their primary goal is not to create AI that fools people into thinking it's human, but rather to enhance AI interactions with a visual layer.

Mentioned in this story

Markets

MicrosoftNASDAQ:MSFT

TopicsSydney PrimasLemon SliceArtificial IntelligenceGenerative MediaVirtual RealityMicrosoft

StartupHub.ai StaffDaniel SingerWritten by StartupHub.ai Staff, Editorial teamReviewed by Daniel Singer, EditorAbout

StartupHub.ai Staff, Editorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer, Editor

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

More from Daniel Singer

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.