# Microsoft Unveils TokenOps for AI Agent Cost Control _Microsoft introduces TokenOps, a run-aware governance system for AI agents to control token spending and move from 'token maxing' to 'value maxing'._ **Published:** 2026-08-22 **Source:** https://www.startuphub.ai/ai-news/artificial-intelligence/2026/microsoft-unveils-tokenops-for-ai-agent-cost-control --- In the rapidly evolving landscape of AI agents, managing costs has become a critical challenge. Tisha Chawla and Susheem Koul from Microsoft addressed this head-on at the AI Engineer World's Fair, presenting "TokenOps," a novel approach to "run-aware token governance for AI agents." The core problem they identified is the difficulty in tracing and controlling the often-unbounded consumption of tokens by AI agents, leading to unexpected and exorbitant bills. AI Agent Cost ControlDriver critical challenge in the rapidly evolving landscape of AI agent developmentFrom the article 5 mentionsNow, in the "agentic era," costs are calculated based on model calls, but a critical gap exists: the lack of a proper control plane that governs the entire agent run, not just individual requests.leads toUnbounded Token ConsumptionDriverAI agents' token usage often difficult to trace and control, leading to high billsFrom the articleTisha Chawla and Susheem Koul from Microsoft addressed this head-on at the AI Engineer World's Fair, presenting "TokenOps," a novel approach to "run-aware token governance for AI agents." The core problem they identified is the difficulty in tracing and controlling the often-unbounded consumption of tokens by AI agents, leading to unexpected and exorbitant bills.drivesShift to Value MaxingContextmoving from maximizing token usage to ensuring expenditure translates into tangible valueFrom the articleChawla began by framing the current industry trend of "token maxing," where teams are proud to be "token billionaires." However, she emphasized that the future lies in "value maxing", ensuring that token expenditure translates into tangible value.necessitatesIntroducing TokenOpsCoreFrom the article 6 mentionsTo address these challenges, Microsoft introduced TokenOps, a system designed for "run-aware token governance for AI agents." The architecture is deliberately "out-of-band" to ensure it does not interfere with the agent's core logic.usesBridge & GovernorCoreTokenOps architecture with a bridge for tracing and a governor for controlFrom the article 2 mentionsSusheem Koul elaborated on the system's architecture, explaining the "bridge" layer that shuffles data between the agent and the control plane.achievesCost ControlOutcomeeffectively managing and reducing unexpected, exorbitant AI agent billsFrom the article 9+ mentionsNow, in the "agentic era," costs are calculated based on model calls, but a critical gap exists: the lack of a proper control plane that governs the entire agent run, not just individual requests.validated byBenchmarking ResultsEffectdemonstrating TokenOps' effectiveness in real-world AI agent scenarios ## The Shift from Token Maxing to Value Maxing Chawla began by framing the current industry trend of "token maxing," where teams are proud to be "token billionaires." However, she emphasized that the future lies in "value maxing", ensuring that token expenditure translates into tangible value. This shift necessitates a move from simply maximizing token usage for exploration to strategically managing it. The presentation drew parallels with previous software evolution eras. In the SaaS era, control was primarily through UI and usage caps like seat limits. The cloud era introduced pay-as-you-go models with controls like auto-provisioning and auto-scaling. Now, in the "agentic era," costs are calculated based on model calls, but a critical gap exists: the lack of a proper control plane that governs the entire agent run, not just individual requests. ## The Problem of Unbounded Consumption The speakers highlighted real-world examples of this issue, citing instances like Uber's AI budget being exhausted within four months and companies incurring multi-million dollar bills within days due to runaway loops. These scenarios underscore the need for robust mechanisms to control the consumption of AI resources. ## First Principles for Token Management Chawla outlined four key first principles for effective token management: - **Tokens are the unit of cost:** Value must also be measured in terms of tokens. - **Cost is created at the LLM call boundary:** This is the critical point to track. - **No attribution, no control:** Every call must be tagged to understand its origin. - **Real-time control is essential:** Bills lag, but control must be in-flight. These principles lead to the realization that a token management layer needs to govern the entire agent run, not just individual requests. This involves having a cumulative budget across all runs, enforcing controls in the call path before spend occurs, and prioritizing steering actions over immediate halting. ## Introducing TokenOps To address these challenges, Microsoft introduced TokenOps, a system designed for "run-aware token governance for AI agents." The architecture is deliberately "out-of-band" to ensure it does not interfere with the agent's core logic. TokenOps comprises three modules: - **Instrumentation:** A common observability layer that collects telemetry, cost data in microns, and attribution information. - **Accounting:** Accumulates run data in a ledger. - **Enforcement:** Steers agent behavior through defined policies and halts execution as a last resort if budgets are exhausted. ## The Bridge and Governor Architecture Susheem Koul elaborated on the system's architecture, explaining the "bridge" layer that shuffles data between the agent and the control plane. Key components include: - **Attribution:** Every agent run is attributed to user dimensions for granular cost tracking. - **Boundary Annotation:** Developers can annotate any method, which then tracks inputs and outputs, flights them to the control layer, and acts as a channel for the control plane to push actions back to the agent. - **Governor:** A node that receives actions from the control plane and knows how to apply them non-destructively, based on developer-defined configurations for allowed actions. ## Benchmarking and Results The presentation included benchmarks showcasing TokenOps' effectiveness. In testing across open-source repositories like BrowserQA and MetaGPT, TokenOps demonstrated an average spend reduction of 78% when fully enabled. This led to an uplift in completion percentages from 67% to 96% compared to simple throttling, highlighting the system's ability to manage costs while maintaining performance. ## Policy Catalog and Future Vision TokenOps supports a comprehensive catalog of ten deterministic policies covering spend management, context management, and loop detection. The system offers two flavors of actions: halt and steer. Looking ahead, the vision includes a self-learning module within TokenOps that can analyze the ledger data, identify new failure modes, generate new policies, and refine existing ones to more effectively manage runaway costs. --- Original analysis from [startuphub.ai](https://www.startuphub.ai), the #1 AI startup directory.