Foundation Models Unlock Time Series Scaling

Toto 2.0 foundation models demonstrate remarkable scaling, achieving state-of-the-art forecasting performance across multiple benchmarks with a unified training approach.

Abstract representation of data streams and AI model connections
Illustrating the scalability and performance of Toto 2.0 forecasting models.
Visual TL;DR
Time Series FragmentationDriver
From the article 4 mentionsThe promise of foundation models has largely been confined to NLP and vision, leaving the critical domain of time series forecasting in a fragmented state.
Toto 2.0 Foundation ModelsCore
new foundation models demonstrate remarkable scalability for time series
From the article 3 mentionsThe five Toto 2.0 forecasting models released under Apache 2.0 are a testament to this unified approach, setting new benchmarks in forecast quality.
Unified Scaling RecipeCore
single training approach effective across millions to billions of parameters
Apache 2.0 ReleaseEffect
From the articleThe five Toto 2.0 forecasting models released under Apache 2.0 are a testament to this unified approach, setting new benchmarks in forecast quality.
Consistent Quality GainsEffect
forecast quality improves reliably with increased model parameter size
From the articleThis work demonstrates that time series models, much like their counterparts in other domains, exhibit remarkable scalability, with a single training recipe yielding consistent forecast quality gains from millions to billions of parameters.
Practical FrameworkEffect
codified insights into a usable and accessible framework for researchers
From the articleThe researchers behind Toto 2.0 have codified this insight into a practical framework.
State-of-the-Art PerformanceOutcome
achieving new benchmarks across multiple forecasting benchmarks
From the articleThe Toto 2.0 forecasting models have established new state-of-the-art results on three distinct forecasting benchmarks: BOOM (observability), GIFT-Eval (general-purpose), and the contamination-resistant TIME benchmark.

The promise of foundation models has largely been confined to NLP and vision, leaving the critical domain of time series forecasting in a fragmented state. This work demonstrates that time series models, much like their counterparts in other domains, exhibit remarkable scalability, with a single training recipe yielding consistent forecast quality gains from millions to billions of parameters. The researchers behind Toto 2.0 have codified this insight into a practical framework.

Unified Scaling Recipe for Forecast Accuracy

The core innovation lies in a robust training methodology that proves effective across a wide spectrum of model sizes, from 4 million to 2.5 billion parameters. This scaling law suggests a path towards highly performant and reliable time series forecasting without the need for bespoke tuning for each parameter class. The five Toto 2.0 forecasting models released under Apache 2.0 are a testament to this unified approach, setting new benchmarks in forecast quality.

State-of-the-Art Performance Across Benchmarks

The Toto 2.0 forecasting models have established new state-of-the-art results on three distinct forecasting benchmarks: BOOM (observability), GIFT-Eval (general-purpose), and the contamination-resistant TIME benchmark. This broad success underscores the generalizability of the architecture and training recipe, addressing a key challenge in the time series domain. The report details not only the experimental outcomes but also the architectural design, training data strategy, and the innovative u-muP hyperparameter transfer pipeline that underpins these achievements.

© 2026 StartupHub.ai. All rights reserved. You may not republish this article in full without a license. Search engines and AI research tools may crawl and summarize for reference. Bulk reproduction or model training requires a license. See our terms.
Daniel Singer

Written by

Daniel Singer

Editor, StartupHub.ai

Daniel Singer is the editor of StartupHub.ai, a technology expert and thought leader on AI and its applications across sectors, from fintech and healthcare to developer tooling and consumer software. He writes and tests the tools covered here thoroughly and regularly, and built StartupHub.ai to give founders, operators and buyers a clearer read on what they are actually being sold.

More from Daniel Singer