Artificial Intelligence

Harvey agents worked but its infra failed

Joey Wang says Harvey's 10,000 agent PRs broke everything around the agents, from checkout to merge queues.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

2 min read

Joey Wang detailed 10,000 agent-written PRs inside Harvey in a talk carried by AI Engineer. The affected system was Spectre, Harvey's internal cloud agent platform, Wang said. No outside attacker was needed to break it.

Harvey agents worked but its infra failed - AI Engineer
Harvey agents worked but its infra failed, AI Engineer

The agents were fine.

Harvey first described Spectre back in April as a harness that becomes the product, Wang said. The program listing adds context the talk skips: Harvey released its cloud agent platform to its own engineers before it shipped long-horizon agents to lawyers. Engineers kept their favorite tools under one rule, that "If a person can click it, an agent can call it."

In May only one Spectre task came from the terminal, Wang said. By October the command line started about 6,500 tasks a month, Wang said. Last month more than one agent started every minute and about 460 people used the platform, Wang said.

Mid-August broke the queue when one buggy release fired hundreds of alerts into one Slack channel, Wang said. About 50 tasks was normal for a day, but about 900 tasks started in four hours, Wang said. A repeat alert now joins the open investigation, Wang said. A later burst of about 950 tasks in three hours forced a fair-share queue, Wang said.

That queue gives keyboard users priority and shows a place in line, Wang said. A 300-task test cut scheduling from almost 2 seconds to 70 milliseconds, Wang said. About 110 people ran scheduled automations last month, Wang said, with auto-off after five straight failures. At the end of October PRs jumped about 60% in a single month and merges stretched from 15 to 30 minutes to over an hour, Wang said. On November 4 volume ran more than twice the busiest August day with better completion, Wang said. Wang set his recheck for six months from now.

Mentioned in this story

Sources

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsHarveySpectreCursorSlackCodexAI EngineerJoey Wang

StartupHub.ai Staff

Written by

StartupHub.ai Staff

Editorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer

Written by

Daniel Singer

Editor, reviewed this article

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.