AI Research

Your Coding Agent Can't Undo Its Mistakes

Sah showed 84% task success but only 47% recovery, and EvoUndo rescued 180 of 197 broken self-improvements.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

2 min read

Tanmay Sah and Dolly Sah demoed UndoBench and EvoUndo for coding agents that touch repos, configs and live deploys, with no attacker needed for the failure on AI Engineer.

Your Coding Agent Can't Undo Its Mistakes - AI Engineer
Your Coding Agent Can't Undo Its Mistakes, AI Engineer

Git revert will not save you.

Sah reported 84% success across 2,880 paired trials in clean runs but only 47% recovery when failures were injected, with naive retries duplicating effects in 54% of commit-then-timeout cases like ticket 781.

Retry is safe before mutation and dangerous after it, so the work calls for retry when nothing changed, restore from saved state when you have it, and compensation when an external action already committed.

EvoUndo implements that by capturing a pre-state witness such as timeout 30 before writing 60, then admitting a self-improvement only if capability rises and an independent verifier confirms full restoration.

They reported 478 of 600 self-evolution trials improved capability while 197 of those improvements carried recovery defects, but richer undo operations rescued 180 of 197 and lifted admissible improvements from 281 to 461.

If you ship agents with deploy or database rights you will need that admission check in the pipeline, while local-only code suggestion can ignore it until it touches state you cannot cheaply rebuild.

Sources

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsTanmay SahDolly SahUndoBenchEvoUndoAI Engineer

StartupHub.ai Staff

Written by

StartupHub.ai Staff

Editorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer

Written by

Daniel Singer

Editor, reviewed this article

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.