1 articles with this tag
<p>OLMo 2 delivers breakthrough performance across benchmarks.</p><p>ARC Challenge (commonsense reasoning): OLMo-2-13B scores 83.5, outperforming Llama-3.1-8B (79.5) and Qwen-2.5-7B (67.4).</p><p>MMLU Massive Multitask Language Understanding (domain-specific knowledge): OLMo-2-13B achieves 67.5, higher than Qwen-2.5-7B (64.4) and Llama-3.1-8B (66.9).</p><p>GSM8k Math Word Problems (mathematical reasoning): OLMo-2-13B scores 75.1, significantly outperforming Llama-3.1-8B (51.3) and Qwen-2.5-7B (63).</p><p>TriviaQA (knowledge recall): OLMo-2-13B achieves 81.9, comparable to Qwen-2.5-7B (81.5) and higher than Llama-3.1-8B (80.3).</p>
