#Model Optimization
2 articles with this tag
AI Research
Pretraining's Hidden Experts Revealed
Large pretrained models contain dense task-specific experts, unlockable via simple random sampling and ensembling, rivaling complex post-training AI model optimization.
about 5 hours ago
AI Research
Pretraining's Hidden Experts: A New Post-Training Paradigm
Large pretrained models are dense with task-experts, enabling simple random sampling and ensembling to rival complex post-training AI optimization methods.
about 5 hours ago