On May 11, 2026, Thinking Machines Lab released TML-Interaction-Small in research preview, a 276-billion-parameter model that processes audio, video, and text in continuous 200-millisecond chunks and returns a response in 0.40 seconds, matching the typical gap between human conversational turns, according to the company’s technical disclosure reported by MarkTechPost on May 13, 2026.
A New Category: What “Interaction Models” Actually Are
“Interaction models” is the term Thinking Machines Lab uses for systems built from scratch to treat real-time conversation as a first architectural principle, not a capability retrofitted onto a text-based foundation. The distinction matters because most voice AI deployed today is exactly that: a large language model with a speech-to-text front end and a text-to-speech back end, coordinated by voice-activity detection software. Murati’s team discarded the VAD layer entirely.
TML-Interaction-Small is a mixture-of-experts model with 276 billion total parameters, of which 12 billion are active at inference time. The model processes incoming audio, video, and text as a continuous stream divided into 200-millisecond chunks. Each chunk is processed as it arrives rather than after the user finishes speaking. Semafor reported on May 13, 2026 that the model reached 0.40 seconds of end-to-end response latency, roughly equivalent to the beat a speaker leaves before replying in ordinary conversation.
The MoE design keeps compute costs tractable despite the large total parameter count. At 12 billion active parameters per forward pass, TML-Interaction-Small sits in a similar inference-compute tier to other deployed mixture-of-experts systems, while the 276 billion total parameters provide the representational breadth that continuous multimodal processing demands.
How TML Differs From Turn-Based Voice Models
The operational gap between TML-Interaction-Small and most deployed voice AI is the distinction between full-duplex and half-duplex conversation. Standard voice models operate on a turn-completion model: the system waits for the user to stop speaking, then processes the full utterance and generates a reply. Interrupting the model mid-response typically forces a restart of the generation cycle, adding several hundred milliseconds to the next exchange.
