The race to serve the next generation of efficient, open AI agents is heating up, and FriendliAI is aggressively positioning itself as the crucial infrastructure layer. The company recently announced it is an official launch partner for NVIDIA’s Nemotron 3 Nano, a move that validates FriendliAI’s specialization in high-performance inference for complex, modern model architectures.
Nemotron 3 Nano represents a significant architectural shift designed specifically for agentic workflows. It employs a hybrid Mamba-Transformer Mixture-of-Experts (MoE) architecture, paired with a massive 1 million-token context window. This combination is engineered to deliver up to 13x higher token generation efficiency, according to NVIDIA, by using techniques like multi-token prediction and NVFP4 quantization.
For developers, this means access to a model built for reliability in complex, multi-step operations—the core requirement for sophisticated AI agents in software development, finance, and enterprise knowledge management. FriendliAI’s role is to ensure this efficiency translates directly into production savings and speed.
FriendliAI claims its custom GPU kernels and specialized MoE serving technologies (like Online Quantization and Speculative Decoding) are necessary to unlock the model’s maximum capabilities. In an industry where inference costs often dwarf training costs, offering 50%+ GPU cost savings and a 99.99% uptime SLA is a powerful pitch to enterprises looking to productionize these new models.
The Agentic Infrastructure Play
Just days earlier, FriendliAI added support for other cutting-edge, agent-focused models, including GLM-4.6 (200k context) and MiniMax-M2 (a sparse MoE model with 128k context).
The common thread across all these additions is a focus on models that excel at reasoning, long-context understanding, and tool-calling—the three pillars of modern agentic AI.
FriendliAI is effectively cornering the market for serving these computationally demanding, yet highly efficient, architectures.
By focusing on the infrastructure needed to run MoE and long-context models reliably and cheaply, FriendliAI is lowering the barrier to entry for startups and enterprises building complex AI systems. It's about the specialized platforms that can handle the complexity of models like Nemotron 3 Nano at scale. This shift ensures that architectural innovation translates into real-world, cost-effective deployments.
