BFCL v4 (multi-turn)
BFCL v4 (multi-turn) - multi-turn state/global evaluation split of BFCL v4 as reported on the Kolibri card.
Category
Agentic
Score type
percent
Scale
100%
higher is better
Models tested
1
What is BFCL v4 (multi-turn)?
BFCL (Berkeley Function Calling Leaderboard) v4 is a collection of function-calling tests: simple and parallel calls, live and irreversible actions, multi-turn conversations and memory. The model must convert user requests into exactly the right tool calls — a wrong argument or a missed restriction loses points.
What does it test?
BFCL v4 (multi-turn) measures agentic abilities such as tool use, retrieval and autonomous workflows. In detail, it checks:
- converting natural language into correct function calls
- parallel and nested (multi-step) tool usage
- asking back instead of guessing on ambiguous or irreversible actions
- remembering earlier constraints across turns
How to read the score
The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better.
Frequently asked questions
What is the BFCL v4 (multi-turn) benchmark?
BFCL (Berkeley Function Calling Leaderboard) v4 is a collection of function-calling tests: simple and parallel calls, live and irreversible actions, multi-turn conversations and memory. The model must convert user requests into exactly the right tool calls — a wrong argument or a missed restriction loses points.
What does BFCL v4 (multi-turn) test?
BFCL v4 (multi-turn) mainly measures agentic abilities such as tool use, retrieval and autonomous workflows. Concretely, it checks: converting natural language into correct function calls; parallel and nested (multi-step) tool usage; asking back instead of guessing on ambiguous or irreversible actions.
How is the BFCL v4 (multi-turn) score calculated?
The score is accuracy: the percentage of tasks answered or solved correctly. 100% means every task was solved perfectly; higher is better. The declared maximum score of this benchmark is 100.0.
Where do I get BFCL v4 (multi-turn) data and scores?
The official benchmark page/reference is linked on this page. Every score on Open LLM Radar is also available as open data: download the scores JSON (http://open-llm-radar-api:8000/api/v1/benchmarks/bfcl-v4-multi-turn/scores) or pull it directly from the Open LLM Radar API with any HTTP client.
Benchmark data & downloads
Where to get, inspect and reuse the data behind this benchmark.
Benchmark dataset
The question/task data itself — download and evaluate locally
Benchmark metadata (JSON)
This page's benchmark record from the Open LLM Radar API
All model scores (JSON download)
Full score table as JSON; paginate with limit/offset params
Open LLM Radar API docs
Swagger UI to explore and reuse all radar API endpoints