AI agents are rapidly moving from experimental toys to tools handling real-world tasks, but governing their actions remains a significant challenge. Databricks is tackling this with Omnigent, an open-source meta-harness that introduces a new approach: contextual policies.
Traditional agent controls offer basic rules like allowing or denying specific tool calls. This approach struggles with nuanced scenarios where the safety or appropriateness of an action depends on what has already occurred within an agent's session.
Omnigent's contextual policies, however, maintain a memory of the agent's session state. This allows them to evaluate subsequent actions based on historical context, such as prior data access or accumulated costs.
Context is Key for Agent Control
The inherent risks of AI agents, from prompt injection to unintended data exposure, necessitate robust governance. Simple allow-lists often lead to overly restrictive controls that hinder usability.
Conversely, constant user prompts lead to fatigue. Contextual policies offer a middle ground by learning from the agent's activity.
