AI Research

OpenAI grades AI on real errands, not exams

OpenAI introduced LifeVal to grade AI on daily tasks like meals, budgets and childcare, not just coding.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

1 min read

OpenAI wants to grade AI on errands, not exams. OpenAI introduced LifeVal to measure how helpful models are in daily life. OpenAI said researchers wanted to know if ChatGPT actually gets things done.

Coding tests don't buy groceries.

LifeVal: Measuring AI progress on the tasks that matter in everyday life.
LifeVal: Measuring AI progress on the tasks that matter in everyday life.

OpenAI said most evals focus on work like coding or math, while LifeVal tests remembering, planning, comparing and following up. The test case is practical: build a grocery list and plan a week of meals for a diabetic parent. OpenAI said LifeVal expects AI to pull health records, dietary preferences and budget, then act on a grocery delivery site instead of writing advice.

LifeVal was built partly from a 3,995-respondent survey covering finding childcare, creating budgets and ordering groceries, Unite.AI reported. OpenAI describes LifeVal as a benchmark spanning childcare, finances and government paperwork. That shifts the target from written answers to completed tasks.

OpenAI said LifeVal shows where models succeeded and where they failed, so OpenAI can improve ChatGPT for everyday use. OpenAI did not say which models pass now, or what score counts as useful enough to trust with health and money.

Mentioned in this story

Sources

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsOpenAILifeValChatGPT

StartupHub.ai Staff

Written by

StartupHub.ai Staff

Editorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer

Written by

Daniel Singer

Editor, reviewed this article

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.