Cloudflare's Sunil Pai & Matt Carrie on Eval++ Compute Primitive

Cloudflare's Sunil Pai & Matt Carrie unveil Eval++, a new compute primitive for building durable, scalable, and low-latency AI agents.

8 min read
Sunil Pai and Matt Carrie of Cloudflare presenting Eval++
Sunil Pai and Matt Carrie from Cloudflare discussing Eval++ at AI Engineer Europe.· AI Engineer

In a recent discussion at AI Engineer Europe, Cloudflare's Sunil Pai and Matt Carrie introduced and elaborated on Eval++, a new compute primitive they believe will be foundational for building and deploying AI agents. The platform is designed to offer durability, reproducibility, and scalability, addressing key challenges in the rapidly evolving field of AI development.

Cloudflare's Sunil Pai & Matt Carrie on Eval++ Compute Primitive - AI Engineer
Cloudflare's Sunil Pai & Matt Carrie on Eval++ Compute Primitive — from AI Engineer

Visual TL;DR. AI Agent Challenges addressed by Eval++ Compute Primitive. Cloudflare Innovators created Eval++ Compute Primitive. Eval++ Compute Primitive has Key Features. Eval++ Compute Primitive enables Enables AI Agents. Key Features leads to Scalable AI. Enables AI Agents achieves Scalable AI. Cloudflare Innovators focuses on Future Vision.

  1. AI Agent Challenges: durability, scalability, and low-latency for AI agents
  2. Cloudflare Innovators: Sunil Pai and Matt Carrie leading AI efforts
  3. Eval++ Compute Primitive: new foundational primitive for AI agents
  4. Key Features: durability, reproducibility, and scalability for AI agents
  5. Enables AI Agents: building and deploying sophisticated AI-powered services
  6. Future Vision: abstracting complex infrastructure for developers
  7. Scalable AI: addressing key challenges in AI development
Visual TL;DR
Visual TL;DR — startuphub.ai AI Agent Challenges addressed by Eval++ Compute Primitive. Cloudflare Innovators created Eval++ Compute Primitive. Eval++ Compute Primitive enables Enables AI Agents. Enables AI Agents achieves Scalable AI addressed by created enables achieves AI Agent Challenges Cloudflare Innovators Eval++ Compute Primitive Enables AI Agents Scalable AI From startuphub.ai · The publishers behind this format
Visual TL;DR — startuphub.ai AI Agent Challenges addressed by Eval++ Compute Primitive. Cloudflare Innovators created Eval++ Compute Primitive. Eval++ Compute Primitive enables Enables AI Agents. Enables AI Agents achieves Scalable AI addressed by created enables achieves AI AgentChallenges CloudflareInnovators Eval++ ComputePrimitive Enables AI Agents Scalable AI From startuphub.ai · The publishers behind this format
Visual TL;DR — startuphub.ai AI Agent Challenges addressed by Eval++ Compute Primitive. Cloudflare Innovators created Eval++ Compute Primitive. Eval++ Compute Primitive enables Enables AI Agents. Enables AI Agents achieves Scalable AI addressed by created enables achieves AI Agent Challenges durability, scalability, and low-latencyfor AI agents Cloudflare Innovators Sunil Pai and Matt Carrie leading AIefforts Eval++ Compute Primitive new foundational primitive for AI agents Enables AI Agents building and deploying sophisticatedAI-powered services Scalable AI addressing key challenges in AIdevelopment From startuphub.ai · The publishers behind this format
Visual TL;DR — startuphub.ai AI Agent Challenges addressed by Eval++ Compute Primitive. Cloudflare Innovators created Eval++ Compute Primitive. Eval++ Compute Primitive enables Enables AI Agents. Enables AI Agents achieves Scalable AI addressed by created enables achieves AI AgentChallenges durability,scalability, andlow-latency for AI… CloudflareInnovators Sunil Pai and MattCarrie leading AIefforts Eval++ ComputePrimitive new foundationalprimitive for AIagents Enables AI Agents building anddeployingsophisticated… Scalable AI addressing keychallenges in AIdevelopment From startuphub.ai · The publishers behind this format
Visual TL;DR — startuphub.ai AI Agent Challenges addressed by Eval++ Compute Primitive. Cloudflare Innovators created Eval++ Compute Primitive. Eval++ Compute Primitive has Key Features. Eval++ Compute Primitive enables Enables AI Agents. Key Features leads to Scalable AI. Enables AI Agents achieves Scalable AI. Cloudflare Innovators focuses on Future Vision addressed by created has enables leads to achieves focuses on AI Agent Challenges durability, scalability, and low-latencyfor AI agents Cloudflare Innovators Sunil Pai and Matt Carrie leading AIefforts Eval++ Compute Primitive new foundational primitive for AI agents Key Features durability, reproducibility, andscalability for AI agents Enables AI Agents building and deploying sophisticatedAI-powered services Future Vision abstracting complex infrastructure fordevelopers Scalable AI addressing key challenges in AIdevelopment From startuphub.ai · The publishers behind this format
Visual TL;DR — startuphub.ai AI Agent Challenges addressed by Eval++ Compute Primitive. Cloudflare Innovators created Eval++ Compute Primitive. Eval++ Compute Primitive has Key Features. Eval++ Compute Primitive enables Enables AI Agents. Key Features leads to Scalable AI. Enables AI Agents achieves Scalable AI. Cloudflare Innovators focuses on Future Vision addressed by created has enables leads to achieves focuses on AI AgentChallenges durability,scalability, andlow-latency for AI… CloudflareInnovators Sunil Pai and MattCarrie leading AIefforts Eval++ ComputePrimitive new foundationalprimitive for AIagents Key Features durability,reproducibility,and scalability for… Enables AI Agents building anddeployingsophisticated… Future Vision abstracting complexinfrastructure fordevelopers Scalable AI addressing keychallenges in AIdevelopment From startuphub.ai · The publishers behind this format

Meet the Innovators: Sunil Pai and Matt Carrie

Sunil Pai and Matt Carrie are key figures at Cloudflare, working on the forefront of their company's efforts in AI and edge computing. Their work focuses on abstracting complex infrastructure to enable developers to build sophisticated applications more easily. Their presentation on Eval++ highlights Cloudflare's commitment to providing the tools necessary for the next generation of AI-powered services.

Related startups

Eval++: The Next Great Compute Primitive

Pai and Carrie positioned Eval++ as a significant advancement in how AI agents can be executed and managed. The core idea behind Eval++ is to provide a robust and scalable environment for AI agents, enabling them to perform tasks reliably and maintain state across multiple interactions. This is crucial for agents that need to remember context, interact with external services, and operate continuously.

The presenters emphasized the importance of stateful compute, a concept that allows agents to retain information and context over time, which is essential for building intelligent systems that can engage in meaningful, long-running interactions. Eval++ aims to abstract this complexity, providing developers with a simpler way to build these stateful agents.

Key Features and Benefits

The Eval++ platform offers several compelling features:

  • Durability and Reproducibility: Agents built on Eval++ are designed to be durable, meaning their state is preserved even through system failures or restarts. This ensures that agents can pick up where they left off, maintaining continuity. Reproducibility is also a key focus, allowing developers to ensure that agents behave consistently under the same conditions.
  • Zero Latency for Agents: By leveraging Cloudflare's global network of Workers, Eval++ aims to provide near-zero latency for AI agent interactions. This is achieved by running agents close to the user, reducing the time it takes for requests to be processed and responses to be delivered.
  • Scalability: The platform is built to scale automatically, handling a massive number of concurrent agent executions without manual intervention. This elasticity is vital for applications that experience unpredictable traffic patterns.
  • Cost-Effectiveness: The pay-as-you-go model of Cloudflare Workers contributes to the cost-effectiveness of Eval++, as users only pay for the compute resources they consume.

Pai and Carrie also touched upon the security aspects, noting that Cloudflare's existing security architecture provides a strong foundation for securing AI agents, including features like Web Application Firewalls (WAF) and DDoS mitigation, which are automatically applied to Worker deployments.

The Vision for AI Agents

The presenters shared their vision for the future of AI agents, emphasizing that they should be able to perform tasks and interact with the world in a more seamless and intelligent manner. They highlighted the potential for AI agents to become a new compute primitive, akin to how Docker containers transformed application deployment. By providing a reliable and performant platform, Cloudflare aims to empower developers to build a wide range of AI-powered applications, from simple chatbots to complex autonomous systems.

The discussion also touched upon the flexibility of the platform, allowing agents to be written in various languages that compile to WebAssembly, such as Rust and C++. While JavaScript is the primary language for Workers, the ability to use other languages broadens the appeal and capability of the Eval++ platform.

© 2026 StartupHub.ai. All rights reserved. Do not enter, scrape, copy, reproduce, or republish this article in whole or in part. Use as input to AI training, fine-tuning, retrieval-augmented generation, or any machine-learning system is prohibited without written license. Substantially-similar derivative works will be pursued to the fullest extent of applicable copyright, database, and computer-misuse laws. See our terms.