Gemini 2.5 Pro (Google) · 2025-06-17

Leaderboard — τ-bench

τ³-Banking Leaderboard

Text agents resolving banking customer-service tasks over a ~700-document knowledge base. Published as τ-knowledge.

Rank	Model	Released	Retrieval	Reasoning	User Sim
#1	Qwen 3.8 Max	Jul 19, 2026	🔍 alltools	xhigh	gpt-5.2	55.2%	▶
#2	Claude Opus 5	Jul 24, 2026	🔍 alltools	max	gpt-5.2	48.7%	▶
#3	Grok 4.5	Jul 16, 2026	🔍 alltools	high	gpt-5.2	47.9%	▶
#4	GPT-5.6-sol	Jul 9, 2026	🔍 alltools	xhigh	gpt-5.2	46.9%	▶
#5	GPT-5.5	Apr 23, 2026	🔍 alltools	xhigh	gpt-5.2	44.6%	▶
#6	Muse Spark 1.1	Jul 9, 2026	🔍 alltools	xhigh	gpt-5.2	40.5%	▶
#7	Claude Opus 4.7	Apr 16, 2026	🔍 alltools	max	gpt-5.2	40.2%	▶
#8	Claude Opus 4.8	May 28, 2026	🔍 alltools	max	gpt-5.2	39.7%	▶
#9	Claude Fable 5	Jun 9, 2026	🔍 alltools	max	gpt-5.2	39.7%	▶
#10	GPT-5.4	Mar 5, 2026	🔍 alltools	xhigh	gpt-5.2	39.4%	▶
#11	Kimi K3	Jul 16, 2026	🔍 alltools	max	gpt-5.2	37.1%	▶
#12	GLM-5.2	Jun 16, 2026	🔍 alltools	xhigh	gpt-5.2	37.1%	▶
#13	GPT-5.2	Dec 11, 2025	🔍 alltools	high	gpt-5.2	32.2%	▶
#14	Gemini 3 Flash	Dec 17, 2025	🔍 Terminal	high	gpt-5.2	27.3%	▶
#15	Claude Opus 4.6	Feb 5, 2026	🔍 alltools	max	gpt-5.2	27.3%	▶
#16	Gemini 3.1 Pro Preview	Feb 19, 2026	🔍 alltools	high	gpt-5.2	26.0%	▶
#17	Claude Sonnet 4.5	Sep 29, 2025	🔍 Terminal	enabled	gpt-5.2	25.3%	▶
#18	Inkling	Jul 15, 2026	🔍 alltools	max	gpt-5.2	25.0%	▶
#19	Claude Opus 4.5	Nov 24, 2025	🔍 alltools	high	gpt-5.2	24.7%	▶
#20	Gemini 3 Pro	Nov 18, 2025	🔍 Terminal	high	gpt-5.2	18.0%	▶
#21	Grok 4.2	Mar 10, 2026	🔍 alltools	high	gpt-5.2	18.0%	▶
#22	Grok 4 fast	Sep 19, 2025	🔍 alltools	high	gpt-5.2	15.7%	▶
#23	Gemini 2.5 Pro	Jun 17, 2025	🔍 alltools	high	gpt-5.2	13.7%	▶
#24	Grok 4.1 fast	Nov 19, 2025	🔍 alltools	high	gpt-5.2	13.1%	▶
#25	GPT-5.2	Dec 11, 2025	🔍 qwen_embeddings	none	gpt-5.2	12.6%	▶
#26	GLM-5	Feb 11, 2026	🔍 text-emb-3-large	enabled	gpt-5.2	9.8%	▶
#27	Qwen3.5-397B-A17B	Feb 16, 2026	🔍 text-emb-3-large	enabled	gpt-5.2	9.8%	▶

τ³-Banking Banking pass@1 by release date

Pass@1 on τ³-Banking · banking · plotted at each model's public release date. 26 models.

Label every model

Google GooglexAI Anthropic Anthropic OpenAI OpenAI🧠Zhipu AI Alibaba Cloud Alibaba CloudZZ.aiMMetaTThinking Machines Lab🚀Moonshot AI Qwen QwenFrontier (best so far)

Markers show each model's banking pass@1 plotted at its public release date. Hover any marker for details. The dashed line tracks the running best. Submissions without a published model_release.release_date fall back to the evaluation date.

Submit Your Results

Have new results to share? Submit your model evaluation results by creating a pull request to add your JSON submission file. See our submission guidelines for the required format and process.