#Transformers
5 articles with this tag
Transformers Conquer Computer Vision
Isaac Robinson from Roboflow explains how Transformers, once confined to NLP, have revolutionized computer vision, surpassing CNNs through massive pre-training and architectural innovation.
EdgeDiT: Transformers on the Edge
EdgeDiT brings high-fidelity generative AI to mobile devices by optimizing Diffusion Transformers for NPUs, achieving significant efficiency gains.
ZipMap: Linear-Time 3D Vision
ZipMap revolutionizes 3D vision with linear-time reconstruction, achieving 20x speedup and enabling real-time state querying.
DynFormer: Smarter AI for Complex Physics
DynFormer, a new dynamics-informed neural operator, significantly reduces error and memory usage in complex PDE simulations by using scale-aware Transformers.
LLMs Lost in Transmission: Why Global Reasoning Fails
A new paper reveals transformer LLMs struggle with complex global reasoning due to limited 'effective bandwidth,' solvable by Chain of Thought.