Update README.md
Browse files
README.md
CHANGED
@@ -94,6 +94,7 @@ The OLMo-2 models have limited safety training, but are not deployed automatical
|
|
94 |
## Performance
|
95 |
|
96 |
| Model | Average | AlpacaEval 2 LC | BBH | DROP | GSM8K | IFEval | MATH | MMLU | Safety | PopQA | TruthQA |
|
|
|
97 |
| **OLMo 1B 0724** | 24.4 | 2.4 | 29.9 | 27.9 | 10.8 | 25.3 | 2.2 | 36.6 | 52.0 | 12.1 | 44.3 |
|
98 |
| **SmolLM2 1.7B** | 34.2 | 5.8 | 39.8 | 30.9 | 45.3 | 51.6 | 20.3 | 34.3 | 52.4 | 16.4 | 45.3 |
|
99 |
| **Gemma 3 1B** | 38.3 | 20.4 | 39.4 | 25.1 | 35.0 | 60.6 | 40.3 | 38.9 | 70.2 | 9.6 | 43.8 |
|
@@ -106,7 +107,6 @@ The OLMo-2 models have limited safety training, but are not deployed automatical
|
|
106 |
|
107 |
|
108 |
|
109 |
-
|
110 |
## License and use
|
111 |
|
112 |
OLMo 2 is licensed under the Apache 2.0 license.
|
|
|
94 |
## Performance
|
95 |
|
96 |
| Model | Average | AlpacaEval 2 LC | BBH | DROP | GSM8K | IFEval | MATH | MMLU | Safety | PopQA | TruthQA |
|
97 |
+
|-------|---------|-----------------|-----|------|-------|--------|------|------|--------|-------|---------|
|
98 |
| **OLMo 1B 0724** | 24.4 | 2.4 | 29.9 | 27.9 | 10.8 | 25.3 | 2.2 | 36.6 | 52.0 | 12.1 | 44.3 |
|
99 |
| **SmolLM2 1.7B** | 34.2 | 5.8 | 39.8 | 30.9 | 45.3 | 51.6 | 20.3 | 34.3 | 52.4 | 16.4 | 45.3 |
|
100 |
| **Gemma 3 1B** | 38.3 | 20.4 | 39.4 | 25.1 | 35.0 | 60.6 | 40.3 | 38.9 | 70.2 | 9.6 | 43.8 |
|
|
|
107 |
|
108 |
|
109 |
|
|
|
110 |
## License and use
|
111 |
|
112 |
OLMo 2 is licensed under the Apache 2.0 license.
|