#Transformer

4 articles with this tag

AI Pioneers Debate Transformer's Future, Urge New Architectures
AI Research

AI Pioneers Debate Transformer's Future, Urge New Architectures

AI pioneers Jerry Tworek and Rohan Anil discuss the limitations of current Transformer architectures and the need for new models that can learn from real-world experience.

3 months ago
Uber's DeepETT Boosts Traffic Forecasts
Technology

Uber's DeepETT Boosts Traffic Forecasts

Uber's DeepETT system revolutionizes traffic forecasting with deep learning, boosting accuracy and handling 2 million predictions per second.

5 months ago
Mamba-3: Inference-First SSMs Arrive
Artificial Intelligence

Mamba-3: Inference-First SSMs Arrive

Together AI's Mamba-3 advances state space models with a focus on inference speed, outperforming previous versions and some Transformers.

7 months ago
Karpathy's microGPT: AI's minimalist masterpiece
Artificial Intelligence

Karpathy's microGPT: AI's minimalist masterpiece

Andrej Karpathy's microGPT is a minimalist, dependency-free Python implementation of a GPT language model, designed as an educational art project to showcase core AI mechanics.

8 months ago