Character.ai Tackles AI Video Quality 'Slop'

The rapid advancements in AI video generation, showcased by models like Sora, Kling, and Veo, have outpaced the development of robust evaluation methods. This gap was highlighted by Mayur Bril from Character.AI during a presentation at the AI Engineer World's Fair. Bril detailed the challenges in assessing the quality of AI-generated video, pointing out that current tools often focus on individual frames or basic prompt adherence, failing to capture the more complex aspects of storytelling, physics, and pacing that define good video content.

StartupHub data

Companies working on this

Profiles of the companies named in this story, with founding year, headquarters, and a short description from our database.

Sora

AI-powered text-to-video generation model and social media app.

Founded

2024

Location

San Francisco, United States

V

Veo

Veo Robotics provides a free-space optical communication system for industrial robots.

Founded

2016

Location

Waltham, United States

Funding

$70M

Character.AI

A leading personal AI platform creating revolutionary open-ended conversational applications.

Founded

2021

Location

Menlo Park, United States

Valuation

$1K

The Problem: Evaluating 'Good Enough' Video

Bril explained that while generating video has become increasingly accessible and affordable, the majority of outputs suffer from common issues like hallucinations, inconsistent physics, and poor audio synchronization. Traditional metrics like CLIP Score, while useful for single frames, and metrics for frame-to-frame consistency (like LPIPS) are insufficient for evaluating the holistic quality of a video as a narrative medium. He noted that even advanced LLM-based judges can be slow and highly dependent on prompt phrasing, leading to inconsistent results.

Introducing 'Judge Judy': A New Evaluation Approach

To address this, Character.AI has developed an open-source video evaluation harness named 'Judge Judy.' The goal is to move evaluation from an offline, often slow process to an integrated, real-time component within the AI video generation pipeline. Bril emphasized the importance of making evaluation 'cheap, consistent, and everywhere,' ideally occurring early in the generation process to catch and correct errors more efficiently.

Key Insights for AI Video Evaluation

Bril shared three core takeaways for those working on AI video generation:

• Go Relative, Not Absolute: Instead of scoring videos on an absolute scale (e.g., 1-10), focus on relative comparisons between outputs. Training models on pairs (A vs. B) leads to more reliable and consistent judgments.
• Score the Real Axes: Evaluate videos based on the criteria that truly matter for storytelling and coherence: the narrative, physics, pacing, and audio sync, not just pixel-level details or prompt adherence.
• Put Eval Inside the Loop: Integrate evaluation metrics directly into the generation process. This allows for early intervention, enabling regeneration of short segments rather than entire videos, thus improving efficiency and quality.

Manufacturing 'Badness' for Better Training

Character.AI's approach to training Judge Judy involved intentionally 'manufacturing badness.' This was achieved by corrupting high-quality real footage and pairing it with AI-generated content to create datasets that teach the model to distinguish between good and bad video attributes. The initial version of the model, while confidently scoring videos, was 'confidently wrong' because it focused on superficial 'gloss' rather than underlying quality. By refining the dataset to include comparisons of real footage against generated content, ensuring consistent encoding and annotation across both, the model became more effective at judging actual video quality.

Addressing Sound and Lip Sync Challenges

In the Q&A, Bril addressed the evaluation of sound, explaining that the model uses audio quality metrics and identifies keyframes to correlate sounds with visual events, such as a door slam matching the action. However, he admitted that lip-syncing remains an unsolved problem in AI video generation, particularly for animated characters where the mouth movements may not have a direct correlation to speech patterns.

The development of 'Judge Judy' represents a significant step towards more reliable and efficient evaluation of AI-generated video, moving beyond simple metrics to a more holistic understanding of video quality as a storytelling medium.