Langroid

Langroid is an open-source Python framework explicitly designed for building complex Large Language Model (LLM)-powered applications using a Multi-Agent Programming paradigm. It addresses the challenge of effectively leveraging LLMs at scale by providing a principled framework where 'Agents' are first-class citizens, encapsulating LLM conversation state, memory (vector-stores), and tools. Inspired by the Actor Framework, Langroid enables intuitive definition of agents, tasks, and task-delegation, facilitating orchestrated multi-agent collaboration. It supports a wide range of LLMs, offers caching, integrates with various vector-stores for Retrieval-Augmented-Generation (RAG), and provides robust tool/function-calling capabilities using Pydantic for simplified development and error handling. The framework also emphasizes observability, logging, and lineage tracking for message provenance.