Format Sensitivity Standard Deviation
BFCL · 40 models
| Rank | Model | Score |
|---|---|---|
| 1 | Ministral-8B-Instruct-2410 (FC) | 0 |
| 2 | Gemini-3-Pro-Preview (Prompt) | 1.7 |
| 3 | Qwen3-235B-A22B-Instruct-2507 (Prompt) | 1.95 |
| 4 | Gemini-2.5-Flash (Prompt) | 2.45 |
| 5 | GPT-5-nano-2025-08-07 (Prompt) | 2.57 |
| 6 | o4-mini-2025-04-16 (Prompt) | 2.6 |
| 7 | o3-2025-04-16 (Prompt) | 2.75 |
| 8 | DeepSeek-V3.2-Exp (Prompt + Thinking) | 2.77 |
| 9 | Grok-4-0709 (Prompt) | 2.88 |
| 10 | GPT-5.2-2025-12-11 (Prompt) | 3.25 |
| 11 | Claude-Opus-4-5-20251101 (Prompt) | 3.65 |
| 12 | Qwen3-32B (Prompt) | 3.75 |
| 13 | GPT-5-mini-2025-08-07 (Prompt) | 3.78 |
| 14 | mistral-large-2411 (Prompt) | 3.91 |
| 15 | Qwen3-14B (Prompt) | 3.97 |
| 16 | Qwen3-30B-A3B-Instruct-2507 (Prompt) | 4.13 |
| 17 | Open-Mistral-Nemo-2407 (Prompt) | 4.6 |
| 18 | Mistral-Medium-2505 | 5.02 |
| 19 | Qwen3-8B (Prompt) | 5.09 |
| 20 | Qwen3-4B-Instruct-2507 (Prompt) | 5.22 |
| 21 | GPT-4.1-2025-04-14 (Prompt) | 6.18 |
| 22 | Gemini-2.5-Flash-Lite (Prompt) | 6.68 |
| 23 | Gemma-3-27b-it (Prompt) | 8.06 |
| 24 | Bielik-11B-v2.3-Instruct (Prompt) | 9.74 |
| 25 | Gemma-3-1b-it (Prompt) | 9.76 |
| 26 | Claude-Sonnet-4-5-20250929 (Prompt) | 10.07 |
| 27 | GPT-4.1-mini-2025-04-14 (Prompt) | 13.33 |
| 28 | Mistral-Small-2506 (Prompt) | 13.57 |
| 29 | MiniCPM3-4B (Prompt) | 16.55 |
| 30 | GPT-4.1-nano-2025-04-14 (Prompt) | 17.08 |
| 31 | Claude-Haiku-4-5-20251001 (Prompt) | 20.07 |
| 32 | Gemma-3-12b-it (Prompt) | 22.41 |
| 33 | Phi-4 (Prompt) | 23.34 |
| 34 | Gemma-3-4b-it (Prompt) | 23.67 |
| 35 | Qwen3-0.6B (Prompt) | 24.35 |
| 36 | RZN-T (Prompt) | 25.53 |
| 37 | CoALM-70B | 27.76 |
| 38 | ToolACE-2-8B (FC) | 27.92 |
| 39 | Llama-3.1-8B-Instruct (Prompt) | 29.1 |
| 40 | CoALM-8B | 34.18 |