Artificial Intelligence

Snowflake says tokens lie, context pays

Snowflake says cheap tokens hide retries and rework, and context is the fix.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

3 min read

Enterprise AI cost dashboard showing accuracy versus prompt cost
Credit: Snowflake

Simar Arora, Senior FinOps Value Advisor at Snowflake, says cost per token misprices enterprise AI. No prediction venue offers odds on that claim, current odds do not exist, volume is zero and nothing has moved. The limit is disclosure: his proof is Snowflake internal benchmarks from May to June 2026. Not financial advice. Markets move fast.

Cheap tokens still buy expensive mistakes.

Snowflake frames the trap with two outside numbers. Inference costs fell more than 99% since 2022, according to the Stanford AI Index Report, while average enterprise reasoning-token use rose about 320x year over year, according to OpenAI enterprise research. Arora argues with co-authors Tehzeeb Versey-Patel, Platform Product Marketing Lead at Snowflake, and Tom Christian, Principal Sales Engineer at Snowflake, that retries, hallucinations and human rework sit below that cheap price. A cheap model that needs three tries costs more than a dearer model that answers once.

The test they cite is narrow and striking. A frontier coding agent with SQL connector hit 24% accuracy at $1.76 per prompt, a bare assistant hit 47% at $0.49, and the same class of model with full business context hit 86% at $0.59, per Snowflake internal accuracy benchmarks across three enterprise data sets. Context added ten cents and delivered 3.6x accuracy. Snowflake calls that shift from data gravity to context gravity, where meaning pulls agents the way volume once pulled apps.

Snowflake wants FinOps for AI to run through a gateway. Its Cortex AI Gateway lists four pillars: model routing, observability, cost controls and security. Visibility must be real time, attribution must tie credits to owner and workflow, quotas must stop loops, and optimization must pick the lightest pattern that clears the quality bar.

Preloop reads the same problem with a wider label. Its 2026 control-plane note says a platform that covers all five primitives earns the name AI agent control plane, while a tool that covers one or two stays a point product such as an MCP gateway or AI gateway. By that test, Snowflake describes enforcement without claiming the full five.

Speakeasy pushes the definition further toward identity. Its architecture note says an AI control plane unifies LLM gateway, MCP gateway, identity, policy and observability so one audit trail covers model calls, tool calls and agents. Snowflake lists identity and tool risk under security, but centers cost per correct governed outcome. The two sides do not agree on whether cost or identity is the center.

Snowflake names the ownership fight and picks no winner. It says the CISO, CIO and CAIO now race to own the unified control plane. If context decides whether work is right the first time, who sets the price for context when tokens cost almost nothing?

Mentioned in this story

Markets

SnowflakeNYSE:SNOW

Sources

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsSnowflakeCortex AI GatewayCortex SenseSimar AroraPreloopSpeakeasyStanford AI IndexOpenAI

StartupHub.ai Staff

Written by

StartupHub.ai StaffEditorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer

Reviewed by

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.