Latency Mean (s)
BFCL · 50 models
| Rank | Model | Score |
|---|---|---|
| 1 | Qwen3-0.6B (FC) | 0.68 |
| 2 | Open-Mistral-Nemo-2407 (Prompt) | 0.84 |
| 3 | Mistral-Small-2506 (Prompt) | 0.92 |
| 4 | Gemini-2.5-Flash-Lite (Prompt) | 1 |
| 5 | GPT-4.1-nano-2025-04-14 (Prompt) | 1.02 |
| 6 | Open-Mistral-Nemo-2407 (FC) | 1.07 |
| 7 | Amazon-Nova-Micro-v1:0 (FC) | 1.12 |
| 8 | Gemini-2.5-Flash-Lite (FC) | 1.18 |
| 9 | GPT-4.1-2025-04-14 (Prompt) | 1.2 |
| 9 | Qwen3-14B (Prompt) | 1.2 |
| 11 | Mistral-Medium-2505 | 1.21 |
| 12 | Qwen3-30B-A3B-Instruct-2507 (Prompt) | 1.24 |
| 13 | GPT-4.1-mini-2025-04-14 (FC) | 1.32 |
| 14 | GPT-4.1-mini-2025-04-14 (Prompt) | 1.36 |
| 15 | Command R7B (FC) | 1.38 |
| 16 | Llama-3.1-Nemotron-Ultra-253B-v1 (FC) | 1.42 |
| 17 | GPT-4.1-nano-2025-04-14 (FC) | 1.44 |
| 18 | Mistral-small-2506 (FC) | 1.48 |
| 19 | Mistral-Medium-2505 (FC) | 1.6 |
| 20 | GPT-4.1-2025-04-14 (FC) | 1.63 |
| 21 | Claude-Haiku-4-5-20251001 (FC) | 1.68 |
| 22 | Granite-4.0-350m (FC) | 1.74 |
| 23 | mistral-large-2411 (Prompt) | 1.82 |
| 24 | mistral-large-2411 (FC) | 2.04 |
| 25 | Command A (FC) | 2.09 |
| 26 | GPT-5.2-2025-12-11 (FC) | 2.23 |
| 27 | Amazon-Nova-Pro-v1:0 (FC) | 2.25 |
| 28 | Grok-4-1-fast-non-reasoning (FC) | 2.29 |
| 29 | Arch-Agent-1.5B | 2.38 |
| 30 | Qwen3-235B-A22B-Instruct-2507 (Prompt) | 2.56 |
| 31 | Qwen3-235B-A22B-Instruct-2507 (FC) | 2.57 |
| 32 | Hammer2.1-0.5b (FC) | 2.79 |
| 33 | xLAM-2-1b-fc-r (FC) | 2.84 |
| 34 | Gemini-2.5-Flash (FC) | 2.99 |
| 35 | Qwen3-0.6B (Prompt) | 3.1 |
| 36 | Gemini-2.5-Flash (Prompt) | 3.18 |
| 37 | Granite-20b-FunctionCalling (FC) | 3.2 |
| 38 | Llama-3.2-1B-Instruct (FC) | 3.21 |
| 39 | Command A Reasoning (FC) | 3.44 |
| 40 | o3-2025-04-16 (FC) | 3.5 |
| 41 | Arch-Agent-3B | 3.56 |
| 42 | o4-mini-2025-04-16 (FC) | 3.71 |
| 42 | palmyra-x-004 (FC) | 3.71 |
| 44 | Claude-Haiku-4-5-20251001 (Prompt) | 3.75 |
| 45 | Claude-Opus-4-5-20251101 (Prompt) | 3.76 |
| 46 | xLAM-2-3b-fc-r (FC) | 3.8 |
| 47 | Claude-Sonnet-4-5-20250929 (Prompt) | 3.84 |
| 48 | Gemma-3-1b-it (Prompt) | 3.98 |
| 49 | GPT-5.2-2025-12-11 (Prompt) | 4.21 |
| 50 | Claude-Sonnet-4-5-20250929 (FC) | 4.31 |