Scaling AI Agents on Kubernetes with OpenClaw

Onur Solmaz, Maintainer at OpenClaw, recently presented on the critical topic of Scaling AI agents on Kubernetes. The talk, titled "Scaling Agents on Kubernetes with acpx and ACP," offered a deep dive into the practical aspects of deploying and managing sophisticated AI agent systems within a containerized orchestration framework.

Understanding Agent Client Protocol (ACP) and acpx

Solmaz began by clarifying the role of the Agent Client Protocol (ACP) and its command-line interface, acpx. ACP is described as a protocol that standardizes communication between agents and their orchestration systems, enabling different agents to interact seamlessly. Acpx, on the other hand, serves as a crucial tool for managing these agents, acting as a CLI for ACP that allows any agent to call another agent over the command line. Solmaz highlighted acpx's evolution into a versatile tool, akin to a "swiss army knife" for ACP management.

The "Firehose" of AI Agent Development

The presentation touched upon the immense scale of development in the AI agent space, illustrating this with data showing "300-500 PRs per day on average" for projects like OpenClaw. This sheer volume underscores the challenge of absorbing requirements from thousands of stakeholders and the need for efficient, scalable solutions. Solmaz emphasized the importance of creating "elegant systems" that can manage these demands without becoming unmaintainable AI slop.

Navigating Agent Interoperability and Orchestration

A significant portion of the talk focused on the complexities of agent interoperability and orchestration, particularly within chat applications like Slack and Teams. Solmaz pointed out that current platforms often lack the native support for multi-agent provisioning and identity management, creating a bottleneck for larger companies. He highlighted the need for "on-demand, disposable agents" that can be managed more flexibly, suggesting that a single OpenClaw instance might not be sufficient for scaling needs.

The "Holy Grail" of Cloud Coding Agents

Solmaz outlined the components that constitute the "holy grail" of cloud coding agents, which include seamless integration with Kubernetes, the use of agent harnesses like OpenClaw or Codex, adherence to ACP, and robust GitHub integration for repository access. Crucially, these agents require read/write access to infrastructure (AWS, Azure, GCloud) and state/data synchronization capabilities. He showcased his own projects, "Spritz" and "Sympozium," as examples of efforts in this direction.

The Role of acpx Flows and Error Reporting

The presentation also delved into the practical application of acpx flows, which are essentially graph-based workflows that drive coding agent harnesses. These workflows are programmed in TypeScript, providing a structured way to manage complex agent interactions. Solmaz also touched upon the critical aspect of error reporting, mentioning tools like Sentry, and how they are integrated into the agent development lifecycle to identify and resolve issues efficiently. He demonstrated how these flows can be visualized and replayed, offering a powerful debugging and development tool.

Conclusion and Future Directions

Solmaz concluded by emphasizing the ongoing evolution of AI agent technology and the critical role of robust infrastructure and protocols like ACP and acpx in enabling scalable and efficient deployments. His work with OpenClaw and Spritz exemplifies the practical challenges and innovative solutions emerging in the field of AI agent orchestration.