Thinking Machines Lab released Inkling on July 15, a 975-billion-parameter open-weight model trained from scratch on 45 trillion tokens of text, image, audio, and video, arriving 22 months after Mira Murati's departure from OpenAI and four months after a gigawatt-scale compute deal with Nvidia.
A 975-Billion-Parameter Model That Knows Its Own Limits
Inkling is a mixture-of-experts system with 975 billion total parameters, of which roughly 41 billion are active on any given query. It was trained on 45 trillion tokens spanning text, image, audio, and video, supports a context window of up to one million tokens, and is available for download through Hugging Face, according to the company's launch post and reporting by TechCrunch and Bloomberg.
