#LLM Architecture
4 articles with this tag
AI Research
Hourglass Reasoning: Unlocking LLM Inductive Power
Hourglass reasoning architecture enforces strict context isolation between LLM reasoning stages, dramatically improving few-shot inductive reasoning.
21 days ago
AI Research
UniPool: Rethinking MoE Efficiency
The UniPool MoE architecture redefines expert capacity, pooling resources globally and enabling sub-linear parameter growth for enhanced efficiency and performance.
3 months ago
AI Research
LLMs Gain Persistent, Verifiable Memory
New hybrid LLM architecture augments parametric knowledge with structured ontological memory for persistent, verifiable, and enhanced reasoning.
3 months ago
AI Research
MoDA: Unlocking LLM Depth Scaling
Mixture-of-Depths Attention (MoDA) tackles LLM signal degradation by enabling cross-layer attention, boosting performance with minimal overhead.
5 months ago