#LLM Architecture
5 articles with this tag
Mobius-v0: Efficient AI Reasoning
The Mobius-v0 architecture redefines LLM efficiency by separating knowledge and reasoning, leading to reduced training data needs and faster inference.
Hourglass Reasoning: Unlocking LLM Inductive Power
Hourglass reasoning architecture enforces strict context isolation between LLM reasoning stages, dramatically improving few-shot inductive reasoning.
UniPool: Rethinking MoE Efficiency
The UniPool MoE architecture redefines expert capacity, pooling resources globally and enabling sub-linear parameter growth for enhanced efficiency and performance.
LLMs Gain Persistent, Verifiable Memory
New hybrid LLM architecture augments parametric knowledge with structured ontological memory for persistent, verifiable, and enhanced reasoning.
MoDA: Unlocking LLM Depth Scaling
Mixture-of-Depths Attention (MoDA) tackles LLM signal degradation by enabling cross-layer attention, boosting performance with minimal overhead.