Bash Reliability
Arena · 50 models
| Rank | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 5 (High) | 0.1498 |
| 2 | Claude Opus 5.5 (Max) | 0.1482 |
| 3 | GPT-6.1 Terra (Max) | 0.1367 |
| 4 | Claude Sonnet 5.5 (Max) | 0.1248 |
| 5 | GPT-6 Sol (Max) | 0.1136 |
| 6 | GPT-5.6 Sol (xHigh) | 0.1121 |
| 7 | Claude Fable 5 (High) | 0.1018 |
| 8 | Claude Opus 5 (Max) | 0.1006 |
| 9 | Gemini 3.8 Flash (High) | 0.0995 |
| 10 | Claude Fable 5.1 (Max) | 0.0993 |
| 11 | GPT-6 Luna (Max) | 0.0967 |
| 12 | Grok 4.6 (xHigh) | 0.0966 |
| 13 | Grok 4.7 (xHigh) | 0.0929 |
| 14 | GPT-6 Astra (Max) | 0.0839 |
| 15 | Muse Wonder Full (Max) | 0.0811 |
| 16 | Kimi K3.1 Pro (Max) | 0.0775 |
| 17 | Claude Haiku 5.5 (High) | 0.0739 |
| 18 | GPT-6 Luna (Medium) | 0.0684 |
| 19 | Gemini 3.7 Flash (High) | 0.0617 |
| 20 | GPT-6.1 Sol (Max) | 0.0514 |
| 21 | Muse Wonder (Max) | 0.0478 |
| 22 | Qwen3.7-Max | 0.0339 |
| 23 | DeepSeek-V4.1-Flash-20261017 (Max) | 0.033 |
| 24 | Inkling-Small | 0.0322 |
| 25 | Beam 1.0 501B A23B | 0.0313 |
| 26 | MiMo-V2.6-Pro | 0.0243 |
| 27 | Muse Spark 1.3 (Max) | 0.0186 |
| 28 | DeepSeek-V4-Pro (High, 20260813) | 0.0161 |
| 29 | GPT-6 Luna (Low) | 0.0144 |
| 30 | Inkling | 0.0108 |
| 31 | Gemini 3.1 Pro Preview | 0.0107 |
| 32 | Qwen3.7-Plus | 0.0073 |
| 33 | GPT-5.6 Terra (xHigh) | 0.0068 |
| 34 | Mistral Large 4 | -0.0069 |
| 35 | MiMo-V2.5-Pro | -0.0095 |
| 36 | MiniMax-M3 | -0.0152 |
| 37 | Muse Spark 1.1 | -0.0257 |
| 38 | Qwen3.8-Max | -0.0287 |
| 39 | Hy4 preview | -0.0311 |
| 40 | Muse Spark 1.2 (xHigh) | -0.0357 |
| 41 | MiMo-V2.6-Flash | -0.0412 |
| 42 | Kimi K3 (Max) | -0.0453 |
| 43 | GLM-5.2 (Max) | -0.0456 |
| 44 | MiniMax-M3.1-Flash | -0.0492 |
| 45 | GLM-5.3 (Max) | -0.0542 |
| 46 | Gemini 4 Argon (High) | -0.0555 |
| 47 | Gemini 4 Carbon (High) | -0.0561 |
| 48 | Mistral Medium 3.5 | -0.079 |
| 49 | Spark-X2.6 | -0.0844 |
| 50 | GLM-5.3-Flash | -0.1131 |