Asking for directions (Dutch)

Language Comprehension

Does the model understand more than just English?

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

	Score
Claude Opus 4.6 (Reasoning)	100%
Gemini 3.1 Pro (Preview)	100%
Z.AI GLM 5 Turbo	100%
Claude Sonnet 4.6 (Reasoning)	100%
GPT-5.4 (Reasoning)	100%
GPT-5.1	100%
Claude Opus 4.6	100%
GPT-5	100%
Qwen 3.5 397B A17B	100%
Qwen 3.5 122B	100%
Grok 4.20 (Beta, Reasoning)	100%
GPT-5.4 (Reasoning, Low)	100%
Z.AI GLM 5	100%
Claude Sonnet 4.6	100%
MoonshotAI: Kimi K2.5	100%
Qwen 3.5 27B	100%
ByteDance Seed 1.6	100%
GPT-5.4 Mini (Reasoning)	100%
Gemini 3 Flash (Preview, Reasoning)	100%
GPT-5.2	100%

	Score	Cost	Time
Mistral NeMO	80%	$0.0000	440ms
Ministral 3 3B	100%	$0.0000	930ms
Gemini 2.5 Flash Lite	80%	$0.0001	735ms
GPT-5.4 Mini	60%	$0.0001	685ms
Gemini 3.1 Flash Lite (Preview)	100%	$0.0001	954ms
Mistral Large 3	100%	$0.0001	984ms
Grok 4.20 (Beta)	60%	$0.0004	571ms
Gemini 2.5 Flash	80%	$0.0002	796ms
Stealth: Aurora Alpha	80%	—	1.2s
Gemini 3 Flash (Preview)	80%	$0.0003	1.2s
Inception Mercury 2	60%	$0.0005	1.0s
Gemma 3 4B	60%	$0.0000	2.0s
Z.AI GLM 4.5	100%	$0.0001	2.4s
Llama 3.1 8B	60%	$0.0000	1.7s
Claude Haiku 4.5	80%	$0.0008	2.0s
GPT-4.1 Mini	80%	$0.0004	3.3s
Claude 3.5 Haiku	60%	$0.0005	1.9s
GPT-5.4 Nano (Reasoning, Low)	80%	$0.0004	4.0s
Grok 4 Fast	100%	$0.0003	3.8s
GPT-5.4 Mini (Reasoning, Low)	100%	$0.0009	3.6s

	Score	Cost	Speed	Stability
Ministral 3 3B	100%	$0.0000	930ms	100%
Mistral Large 3	100%	$0.0001	984ms	100%
Gemini 3.1 Flash Lite (Preview)	100%	$0.0001	954ms	100%
Z.AI GLM 4.5	100%	$0.0001	2.4s	100%
Grok 4 Fast	100%	$0.0003	3.8s	100%
GPT-5.4 Mini (Reasoning, Low)	100%	$0.0009	3.6s	100%
GPT-4.1	100%	$0.0014	3.1s	100%
GPT-4o, May 13th (temp=1)	100%	$0.0017	2.6s	100%
GPT-4o, May 13th (temp=0)	100%	$0.0018	2.5s	100%
Qwen 3.5 Plus (2026-02-15)	100%	$0.0003	5.5s	100%
DeepSeek V3 (2024-12-26)	100%	$0.0002	5.9s	100%
Mistral Large 2	100%	$0.0011	5.0s	100%
GPT-5.4 Nano (Reasoning)	100%	$0.0005	6.1s	100%
Claude Sonnet 4.6	100%	$0.0026	3.2s	100%
Claude Sonnet 4	100%	$0.0026	3.6s	100%
Gemini 3 Flash (Preview, Reasoning)	100%	$0.0022	4.9s	100%
Claude Sonnet 4.5	100%	$0.0030	3.6s	100%
GPT-5.4 (Reasoning, Low)	100%	$0.0028	4.2s	100%
DeepSeek V3.1	100%	$0.0003	8.8s	100%
GPT-5.2	100%	$0.0027	4.9s	100%

Language Comprehension

Asking for directions (Dutch)

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Rank	Model	Avg. Cost	Avg. Time	Stability	# 1	# 2	# 3	# 4	# 5	Total
38	Claude Opus 4.6 (Reasoning)	$0.011	8.1s	100%	100	100	100	100	100	100%
42	Gemini 3.1 Pro (Preview)	$0.012	12.6s	100%	100	100	100	100	100	100%
28	Z.AI GLM 5 Turbo	$0.0031	9.9s	100%	100	100	100	100	100	100%
36	Claude Sonnet 4.6 (Reasoning)	$0.0077	12.1s	100%	100	100	100	100	100	100%
32	GPT-5.4 (Reasoning)	$0.0055	9.8s	100%	100	100	100	100	100	100%
30	GPT-5.1	$0.0041	9.4s	100%	100	100	100	100	100	100%
26	Claude Opus 4.6	$0.0049	4.8s	100%	100	100	100	100	100	100%
50	GPT-5	$0.014	26.9s	100%	100	100	100	100	100	100%
46	Qwen 3.5 397B A17B	$0.0049	39.2s	100%	100	100	100	100	100	100%
41	Qwen 3.5 122B	$0.0075	20.4s	100%	100	100	100	100	100	100%
48	Grok 4.20 (Beta, Reasoning)	$0.020	13.7s	100%	100	100	100	100	100	100%
18	GPT-5.4 (Reasoning, Low)	$0.0028	4.2s	100%	100	100	100	100	100	100%
53	Z.AI GLM 5	$0.0044	1.2m	100%	100	100	100	100	100	100%
14	Claude Sonnet 4.6	$0.0026	3.2s	100%	100	100	100	100	100	100%
49	MoonshotAI: Kimi K2.5	$0.0059	40.3s	100%	100	100	100	100	100	100%
47	Qwen 3.5 27B	$0.0081	34.2s	100%	100	100	100	100	100	100%
29	ByteDance Seed 1.6	$0.0011	13.6s	100%	100	100	100	100	100	100%
22	GPT-5.4 Mini (Reasoning)	$0.0019	7.9s	100%	100	100	100	100	100	100%
16	Gemini 3 Flash (Preview, Reasoning)	$0.0022	4.9s	100%	100	100	100	100	100	100%
20	GPT-5.2	$0.0027	4.9s	100%	100	100	100	100	100	100%
24	Claude Opus 4.5	$0.0047	3.9s	100%	100	100	100	100	100	100%
27	Grok 4.1 Fast	$0.0009	13.3s	100%	100	100	100	100	100	100%
34	Aion 2.0	$0.0014	19.3s	100%	100	100	100	100	100	100%
43	Z.AI GLM 4.6	$0.0022	36.6s	100%	100	100	100	100	100	100%
51	MiniMax M2.7	$0.0036	57.7s	100%	100	100	100	100	100	100%
40	Gemini 3 Pro (Preview)	$0.013	9.6s	100%	100	100	100	100	100	100%
15	Claude Sonnet 4	$0.0026	3.6s	100%	100	100	100	100	100	100%
44	Z.AI GLM 4.7	$0.0028	37.8s	100%	100	100	100	100	100	100%
7	GPT-4.1	$0.0014	3.1s	100%	100	100	100	100	100	100%
35	Gemini 2.5 Pro	$0.0089	8.2s	100%	100	100	100	100	100	100%
17	Claude Sonnet 4.5	$0.0030	3.6s	100%	100	100	100	100	100	100%
39	Qwen 3.5 35B	$0.0066	19.4s	100%	100	100	100	100	100	100%
37	Claude Opus 4	$0.0098	8.5s	100%	100	100	100	100	100	100%
54	ByteDance Seed 2.0 Mini	$0.0023	2.6m	100%	100	100	100	100	100	100%
4	Z.AI GLM 4.5	$0.0001	2.4s	100%	100	100	100	100	100	100%
5	Grok 4 Fast	$0.0003	3.8s	100%	100	100	100	100	100	100%
52	Qwen 3.5 9B	$0.0006	1.2m	100%	100	100	100	100	100	100%
10	Qwen 3.5 Plus (2026-02-15)	$0.0003	5.5s	100%	100	100	100	100	100	100%
3	Gemini 3.1 Flash Lite (Preview)	$0.0001	954ms	100%	100	100	100	100	100	100%
6	GPT-5.4 Mini (Reasoning, Low)	$0.0009	3.6s	100%	100	100	100	100	100	100%
2	Mistral Large 3	$0.0001	984ms	100%	100	100	100	100	100	100%
9	GPT-4o, May 13th (temp=0)	$0.0018	2.5s	100%	100	100	100	100	100	100%
21	DeepSeek-V2 Chat	$0.0001	10.3s	100%	100	100	100	100	100	100%
31	Z.AI GLM 4.7 Flash	$0.0004	16.8s	100%	100	100	100	100	100	100%
45	ByteDance Seed 2.0 Lite	$0.0033	37.9s	100%	100	100	100	100	100	100%
8	GPT-4o, May 13th (temp=1)	$0.0017	2.6s	100%	100	100	100	100	100	100%
11	DeepSeek V3 (2024-12-26)	$0.0002	5.9s	100%	100	100	100	100	100	100%
23	Hermes 3 405B	$0.0000	11.9s	100%	100	100	100	100	100	100%
12	Mistral Large 2	$0.0011	5.0s	100%	100	100	100	100	100	100%
19	DeepSeek V3.1	$0.0003	8.8s	100%	100	100	100	100	100	100%
33	DeepSeek V3.2	$0.0003	20.0s	100%	100	100	100	100	100	100%
25	DeepSeek V3 (2025-03-24)	$0.0001	12.0s	100%	100	100	100	100	100	100%
13	GPT-5.4 Nano (Reasoning)	$0.0005	6.1s	100%	100	100	100	100	100	100%
1	Ministral 3 3B	$0.0000	930ms	100%	100	100	100	100	100	100%
65	GPT-5 Mini	$0.0015	12.3s	20%	100	100	100	100	0	80%
68	o4 Mini High	$0.0040	12.7s	20%	100	100	100	100	0	80%
73	MiniMax M2.5	$0.0025	40.2s	20%	100	100	100	100	0	80%
64	Stealth: Hunter Alpha	$0.0000	8.7s	20%	100	100	100	100	0	80%
70	Gemini 2.5 Flash (Reasoning)	$0.0072	13.3s	20%	100	100	100	100	0	80%
71	Qwen 3.5 Flash	$0.0017	29.1s	20%	100	100	100	100	0	80%
72	Gemini 2.5 Flash Lite (Reasoning)	$0.0010	33.3s	20%	100	100	100	100	0	80%
58	Gemini 3 Flash (Preview)	$0.0003	1.2s	20%	100	100	100	100	0	80%
59	Claude Haiku 4.5	$0.0008	2.0s	20%	100	100	100	100	0	80%
74	Stealth: Aurora Alpha	—	1.2s	20%	100	100	100	100	0	80%
60	GPT-4.1 Mini	$0.0004	3.3s	20%	100	100	100	100	0	80%
67	GPT-5 Nano	$0.0006	17.3s	20%	100	100	100	100	0	80%
69	Qwen 3 32B	$0.0005	20.3s	20%	100	100	100	100	0	80%
56	Gemini 2.5 Flash Lite	$0.0001	735ms	20%	100	100	100	100	0	80%
57	Gemini 2.5 Flash	$0.0002	796ms	20%	100	100	100	100	0	80%
66	Qwen3 235B A22B Instruct 2507	$0.0002	15.7s	20%	100	100	100	100	0	80%
63	Writer: Palmyra X5	$0.0016	5.6s	20%	100	100	100	100	0	80%
61	GPT-5.4 Nano (Reasoning, Low)	$0.0004	4.0s	20%	100	100	100	100	0	80%
62	WizardLM 2 8x22b	$0.0003	6.3s	20%	100	100	100	100	0	80%
55	Mistral NeMO	$0.0000	440ms	20%	100	100	100	100	0	80%
118	Grok 4	$0.132	3.8m	2%	100	100	100	0	0	60%
85	Stealth: Healer Alpha	$0.0000	18.5s	2%	100	100	100	0	0	60%
82	GPT-5.4	$0.0020	2.2s	2%	100	100	100	0	0	60%
76	Grok 4.20 (Beta)	$0.0004	571ms	2%	100	100	100	0	0	60%
78	Inception Mercury 2	$0.0005	1.0s	2%	100	100	100	0	0	60%
80	Claude 3.5 Haiku	$0.0005	1.9s	2%	100	100	100	0	0	60%
83	Claude 3.7 Sonnet	$0.0023	3.4s	2%	100	100	100	0	0	60%
75	GPT-5.4 Mini	$0.0001	685ms	2%	100	100	100	0	0	60%
81	Mistral Large	$0.0011	3.5s	2%	100	100	100	0	0	60%
84	Nemotron 3 Nano	$0.0002	10.9s	2%	100	100	100	0	0	60%
79	Gemma 3 4B	$0.0000	2.0s	2%	100	100	100	0	0	60%
77	Llama 3.1 8B	$0.0000	1.7s	2%	100	100	100	0	0	60%
95	o4 Mini	$0.0020	5.2s	0%	100	100	0	0	0	40%
97	Nemotron 3 Super	$0.0000	12.1s	0%	100	100	0	0	0	40%
88	GPT-5.4 Nano	$0.0001	1.1s	0%	100	100	0	0	0	40%
91	Arcee AI: Trinity Large (Preview)	$0.0000	1.9s	0%	100	100	0	0	0	40%
94	ByteDance Seed 1.6 Flash	$0.0003	6.0s	0%	100	100	0	0	0	40%
90	GPT-4.1 Nano	$0.0000	1.6s	0%	100	100	0	0	0	40%
89	Claude 3 Haiku	$0.0001	1.4s	0%	100	100	0	0	0	40%
92	Arcee AI: Trinity Mini	$0.0001	2.6s	0%	100	100	0	0	0	40%
96	Cohere Command R+ (Aug. 2024)	$0.0027	5.5s	0%	100	100	0	0	0	40%
87	Ministral 8B	$0.0000	354ms	0%	100	100	0	0	0	40%
86	Ministral 3B	$0.0000	309ms	0%	100	100	0	0	0	40%
93	Rocinante 12B	$0.0001	5.7s	0%	100	100	0	0	0	40%
103	Claude 3.5 Sonnet	$0.0019	3.4s	0%	100	0	0	0	0	20%
99	GPT-4o, Aug. 6th (temp=1)	$0.0006	1.3s	0%	100	0	0	0	0	20%
98	Inception Mercury	$0.0000	685ms	0%	100	0	0	0	0	20%
101	Llama 3.1 70B	$0.0002	3.4s	0%	100	0	0	0	0	20%
104	Llama 3.1 Nemotron 70B	$0.0002	13.0s	0%	100	0	0	0	0	20%
100	Hermes 3 70B	$0.0001	3.2s	0%	100	0	0	0	0	20%
102	LFM2 24B	$0.0000	4.0s	0%	100	0	0	0	0	20%
111	GPT-4o, Aug. 6th (temp=0)	$0.0006	1.7s	0%	0	0	0	0	0	0%
117	Mistral Small 4 (Reasoning)	$0.0007	8.1s	0%	0	0	0	0	0	0%
107	GPT-4o Mini (temp=1)	$0.0000	923ms	0%	0	0	0	0	0	0%
112	Mistral Small 3.2 24B	$0.0001	3.2s	0%	0	0	0	0	0	0%
115	Gemma 3 12B	$0.0000	4.2s	0%	0	0	0	0	0	0%
108	GPT-4o Mini (temp=0)	$0.0000	1.0s	0%	0	0	0	0	0	0%
116	Gemma 3 27B	$0.0001	7.2s	0%	0	0	0	0	0	0%
113	Mistral Medium 3.1	$0.0004	2.8s	0%	0	0	0	0	0	0%
110	Mistral Small 4	$0.0001	1.2s	0%	0	0	0	0	0	0%
114	Qwen 2.5 72B	$0.0001	3.4s	0%	0	0	0	0	0	0%
109	Mistral Small Creative	$0.0001	1.0s	0%	0	0	0	0	0	0%
106	Ministral 3 14B	$0.0000	816ms	0%	0	0	0	0	0	0%
105	Ministral 3 8B	$0.0000	729ms	0%	0	0	0	0	0	0%
70.68%