Asking for directions (Dutch)

Language Comprehension

Does the model understand more than just English?

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

	Score
GPT-5.6 Sol (Reasoning)	100%
Claude Opus 4.6 (Reasoning)	100%
Gemini 3.6 Flash (Reasoning)	100%
Qwen3.7 Max	100%
Grok 4.5 (Reasoning, High)	100%
Gemini 3.1 Pro (Preview)	100%
GPT-5.4 (Reasoning)	100%
Muse Spark 1.1 (Reasoning, Medium)	100%
Qwen3.6 Max Preview	100%
GPT-5.5 (Reasoning)	100%
Claude Sonnet 4.6 (Reasoning)	100%
Z.AI GLM 5.2 (Reasoning, High)	100%
Gemini 3.5 Flash (Reasoning)	100%
Z.AI GLM 5 Turbo	100%
MoonshotAI: Kimi K3 (Reasoning, High)	100%
MoonshotAI: Kimi K2.6	100%
Claude Opus 4.7 (Reasoning)	100%
GPT-5.5 (Reasoning, Low)	100%
GPT-5.6 Terra (Reasoning)	100%
Claude Opus 4.8 (Reasoning)	100%

	Score	Cost	Time
Mistral NeMO	80%	$0.0000	440ms
Ministral 3 3B	100%	$0.0000	930ms
Gemini 2.5 Flash Lite	80%	$0.0001	735ms
Mistral Large 3	100%	$0.0001	984ms
Gemini 3.1 Flash Lite (Preview)	100%	$0.0001	954ms
Gemma 4 31B	100%	$0.0000	2.2s
Gemma 3 4B	60%	$0.0000	2.0s
GPT-5.4 Mini	60%	$0.0001	685ms
Gemini 3.1 Flash Lite	100%	$0.0002	1.0s
Gemini 3.1 Flash Lite (Reasoning)	100%	$0.0002	1.1s
Thinking Machines Inkling	80%	$0.0003	1.7s
Gemma 4 26B	100%	$0.0000	7.2s
Z.AI GLM 4.5	100%	$0.0001	2.4s
Grok 4.3	80%	$0.0003	1.1s
GPT-5.6 Luna	100%	$0.0003	1.0s
Gemini 2.5 Flash	80%	$0.0002	796ms
Gemini 3 Flash (Preview)	80%	$0.0003	1.2s
Gemini 3.5 Flash Lite (Reasoning)	100%	$0.0004	780ms
Cydonia 24B V4.1	80%	$0.0001	2.7s
Laguna S 2.1	100%	$0.0001	4.9s

	Score	Cost	Speed	Stability
Ministral 3 3B	100%	$0.0000	930ms	100%
Mistral Large 3	100%	$0.0001	984ms	100%
Gemma 4 31B	100%	$0.0000	2.2s	100%
Gemini 3.1 Flash Lite (Preview)	100%	$0.0001	954ms	100%
Gemini 3.1 Flash Lite (Reasoning)	100%	$0.0002	1.1s	100%
Gemini 3.1 Flash Lite	100%	$0.0002	1.0s	100%
Z.AI GLM 4.5	100%	$0.0001	2.4s	100%
GPT-5.6 Luna	100%	$0.0003	1.0s	100%
Laguna S 2.1	100%	$0.0001	4.9s	100%
Gemini 3.5 Flash Lite (Reasoning)	100%	$0.0004	780ms	100%
Gemma 4 26B	100%	$0.0000	7.2s	100%
Gemini 3.5 Flash Lite (Reasoning, Minimal)	100%	$0.0005	887ms	100%
DeepSeek V3 (2024-12-26)	100%	$0.0002	5.9s	100%
Qwen 3.5 Plus (2026-02-15)	100%	$0.0003	5.5s	100%
DeepSeek-V2 Chat	100%	$0.0001	10.3s	100%
Hermes 3 405B	100%	$0.0000	11.9s	100%
GPT-5.6 Terra	100%	$0.0007	1.1s	100%
DeepSeek V3.1	100%	$0.0003	8.8s	100%
DeepSeek V3 (2025-03-24)	100%	$0.0001	12.0s	100%
GPT-5.4 Nano (Reasoning)	100%	$0.0005	6.1s	100%

Language Comprehension

Asking for directions (Dutch)

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Rank	Model	Avg. Cost	Avg. Time	Stability	# 1	# 2	# 3	# 4	# 5	Total
59	GPT-5.6 Sol (Reasoning)	$0.0050	3.6s	100%	100	100	100	100	100	100%
85	Claude Opus 4.6 (Reasoning)	$0.011	8.1s	100%	100	100	100	100	100	100%
84	Gemini 3.6 Flash (Reasoning)	$0.010	6.3s	100%	100	100	100	100	100	100%
118	Qwen3.7 Max	$0.032	1.1m	100%	100	100	100	100	100	100%
80	Grok 4.5 (Reasoning, High)	$0.0088	19.4s	100%	100	100	100	100	100	100%
89	Gemini 3.1 Pro (Preview)	$0.012	12.6s	100%	100	100	100	100	100	100%
64	GPT-5.4 (Reasoning)	$0.0055	9.8s	100%	100	100	100	100	100	100%
79	Muse Spark 1.1 (Reasoning, Medium)	$0.0086	13.9s	100%	100	100	100	100	100	100%
97	Qwen3.6 Max Preview	$0.014	50.6s	100%	100	100	100	100	100	100%
88	GPT-5.5 (Reasoning)	$0.012	10.2s	100%	100	100	100	100	100	100%
73	Claude Sonnet 4.6 (Reasoning)	$0.0077	12.1s	100%	100	100	100	100	100	100%
51	Z.AI GLM 5.2 (Reasoning, High)	$0.0036	15.6s	100%	100	100	100	100	100	100%
77	Gemini 3.5 Flash (Reasoning)	$0.0091	4.9s	100%	100	100	100	100	100	100%
47	Z.AI GLM 5 Turbo	$0.0031	9.9s	100%	100	100	100	100	100	100%
82	MoonshotAI: Kimi K3 (Reasoning, High)	$0.0090	18.9s	100%	100	100	100	100	100	100%
98	MoonshotAI: Kimi K2.6	$0.014	1.5m	100%	100	100	100	100	100	100%
67	Claude Opus 4.7 (Reasoning)	$0.0071	3.4s	100%	100	100	100	100	100	100%
62	GPT-5.5 (Reasoning, Low)	$0.0056	4.9s	100%	100	100	100	100	100	100%
36	GPT-5.6 Terra (Reasoning)	$0.0022	3.3s	100%	100	100	100	100	100	100%
87	Claude Opus 4.8 (Reasoning)	$0.012	6.1s	100%	100	100	100	100	100	100%
58	Claude Opus 4.6	$0.0049	4.8s	100%	100	100	100	100	100	100%
63	MoonshotAI: Kimi K3 (Reasoning, Low)	$0.0053	11.8s	100%	100	100	100	100	100	100%
96	Claude Opus 5 (Reasoning, Low)	$0.016	9.3s	100%	100	100	100	100	100	100%
93	Claude Opus 4.8 (Reasoning, Low)	$0.014	7.0s	100%	100	100	100	100	100	100%
95	GPT-5	$0.014	26.9s	100%	100	100	100	100	100	100%
75	Muse Spark 1.1 (Reasoning, Minimal)	$0.0080	12.5s	100%	100	100	100	100	100	100%
94	Claude Opus 5 (Reasoning)	$0.014	8.3s	100%	100	100	100	100	100	100%
66	Qwen 3.5 397B A17B	$0.0049	39.2s	100%	100	100	100	100	100	100%
92	Grok 4.3 (Reasoning)	$0.010	1.2m	100%	100	100	100	100	100	100%
48	Grok 4.5 (Reasoning, Low)	$0.0034	6.5s	100%	100	100	100	100	100	100%
45	GPT-5.4 (Reasoning, Low)	$0.0028	4.2s	100%	100	100	100	100	100	100%
90	Grok 4.20 (Reasoning)	$0.011	44.8s	100%	100	100	100	100	100	100%
72	MoonshotAI: Kimi K2.5	$0.0059	40.3s	100%	100	100	100	100	100	100%
39	Thinking Machines Inkling (Reasoning)	$0.0024	5.7s	100%	100	100	100	100	100	100%
52	GPT-5.1	$0.0041	9.4s	100%	100	100	100	100	100	100%
40	Claude Sonnet 4.6	$0.0026	3.2s	100%	100	100	100	100	100	100%
26	GPT-5.6 Luna (Reasoning)	$0.0011	2.9s	100%	100	100	100	100	100	100%
50	MiniMax M3	$0.0019	43.3s	100%	100	100	100	100	100	100%
54	Claude Sonnet 5 (Reasoning)	$0.0044	6.2s	100%	100	100	100	100	100	100%
74	Qwen 3.5 122B	$0.0075	20.4s	100%	100	100	100	100	100	100%
53	Claude Sonnet 5 (Reasoning, Low)	$0.0043	6.2s	100%	100	100	100	100	100	100%
81	Qwen 3.5 27B	$0.0081	34.2s	100%	100	100	100	100	100	100%
69	Claude Opus 5	$0.0071	5.3s	100%	100	100	100	100	100	100%
37	Gemini 3 Flash (Preview, Reasoning)	$0.0022	4.9s	100%	100	100	100	100	100	100%
68	Claude Opus 4.7	$0.0072	3.2s	100%	100	100	100	100	100	100%
34	GPT-5.4 Mini (Reasoning)	$0.0019	7.9s	100%	100	100	100	100	100	100%
70	Qwen 3.5 Plus (2026-04-20)	$0.0051	39.9s	100%	100	100	100	100	100	100%
25	Gemma 4 31B (Reasoning)	$0.0002	16.8s	100%	100	100	100	100	100	100%
55	Claude Opus 4.5	$0.0047	3.9s	100%	100	100	100	100	100	100%
76	Z.AI GLM 5	$0.0044	1.2m	100%	100	100	100	100	100	100%
33	ByteDance Seed 1.6	$0.0011	13.6s	100%	100	100	100	100	100	100%
42	GPT-5.2	$0.0027	4.9s	100%	100	100	100	100	100	100%
32	GPT-5.5	$0.0017	1.7s	100%	100	100	100	100	100	100%
21	Gemma 4 26B (Reasoning)	$0.0003	10.7s	100%	100	100	100	100	100	100%
78	Gemini 2.5 Pro	$0.0089	8.2s	100%	100	100	100	100	100	100%
61	Qwen 3.6 27B	$0.0045	21.9s	100%	100	100	100	100	100	100%
17	GPT-5.6 Terra	$0.0007	1.1s	100%	100	100	100	100	100	100%
91	DeepSeek V4 Flash (Reasoning)	$0.0004	3.8m	100%	100	100	100	100	100	100%
57	Z.AI GLM 4.7	$0.0028	37.8s	100%	100	100	100	100	100	100%
43	Qwen 3.6 35B	$0.0023	11.1s	100%	100	100	100	100	100	100%
49	Z.AI GLM 4.6	$0.0022	36.6s	100%	100	100	100	100	100	100%
41	Claude Sonnet 4	$0.0026	3.6s	100%	100	100	100	100	100	100%
46	Claude Sonnet 4.5	$0.0030	3.6s	100%	100	100	100	100	100	100%
44	Claude Sonnet 5	$0.0027	4.2s	100%	100	100	100	100	100	100%
83	Claude Opus 4	$0.0098	8.5s	100%	100	100	100	100	100	100%
71	Qwen 3.5 35B	$0.0066	19.4s	100%	100	100	100	100	100	100%
31	GPT-4.1	$0.0014	3.1s	100%	100	100	100	100	100	100%
22	Gemini 3.6 Flash (Reasoning, Minimal)	$0.0010	1.1s	100%	100	100	100	100	100	100%
38	Aion 2.0	$0.0014	19.3s	100%	100	100	100	100	100	100%
65	MiniMax M2.7	$0.0036	57.7s	100%	100	100	100	100	100	100%
14	Qwen 3.5 Plus (2026-02-15)	$0.0003	5.5s	100%	100	100	100	100	100	100%
5	Gemini 3.1 Flash Lite (Reasoning)	$0.0002	1.1s	100%	100	100	100	100	100	100%
28	Gemini 3.5 Flash (Reasoning, Minimal)	$0.0013	1.2s	100%	100	100	100	100	100	100%
86	ByteDance Seed 2.0 Mini	$0.0023	2.6m	100%	100	100	100	100	100	100%
4	Gemini 3.1 Flash Lite (Preview)	$0.0001	954ms	100%	100	100	100	100	100	100%
3	Gemma 4 31B	$0.0000	2.2s	100%	100	100	100	100	100	100%
6	Gemini 3.1 Flash Lite	$0.0002	1.0s	100%	100	100	100	100	100	100%
8	GPT-5.6 Luna	$0.0003	1.0s	100%	100	100	100	100	100	100%
7	Z.AI GLM 4.5	$0.0001	2.4s	100%	100	100	100	100	100	100%
11	Gemma 4 26B	$0.0000	7.2s	100%	100	100	100	100	100	100%
24	GPT-OSS 120B	$0.0002	16.4s	100%	100	100	100	100	100	100%
12	Gemini 3.5 Flash Lite (Reasoning, Minimal)	$0.0005	887ms	100%	100	100	100	100	100	100%
10	Gemini 3.5 Flash Lite (Reasoning)	$0.0004	780ms	100%	100	100	100	100	100	100%
2	Mistral Large 3	$0.0001	984ms	100%	100	100	100	100	100	100%
60	ByteDance Seed 2.0 Lite	$0.0033	37.9s	100%	100	100	100	100	100	100%
15	DeepSeek-V2 Chat	$0.0001	10.3s	100%	100	100	100	100	100	100%
56	Qwen 3.5 9B	$0.0006	1.2m	100%	100	100	100	100	100	100%
23	GPT-5.4 Mini (Reasoning, Low)	$0.0009	3.6s	100%	100	100	100	100	100	100%
13	DeepSeek V3 (2024-12-26)	$0.0002	5.9s	100%	100	100	100	100	100	100%
18	DeepSeek V3.1	$0.0003	8.8s	100%	100	100	100	100	100	100%
30	DeepSeek V3.2	$0.0003	20.0s	100%	100	100	100	100	100	100%
29	Z.AI GLM 4.7 Flash	$0.0004	16.8s	100%	100	100	100	100	100	100%
27	Mistral Large 2	$0.0011	5.0s	100%	100	100	100	100	100	100%
16	Hermes 3 405B	$0.0000	11.9s	100%	100	100	100	100	100	100%
35	Z.AI GLM 4.5 Air	$0.0012	20.0s	100%	100	100	100	100	100	100%
20	GPT-5.4 Nano (Reasoning)	$0.0005	6.1s	100%	100	100	100	100	100	100%
9	Laguna S 2.1	$0.0001	4.9s	100%	100	100	100	100	100	100%
19	DeepSeek V3 (2025-03-24)	$0.0001	12.0s	100%	100	100	100	100	100	100%
1	Ministral 3 3B	$0.0000	930ms	100%	100	100	100	100	100	100%
124	Z.AI GLM 5.1	$0.0043	36.9s	20%	100	100	100	100	0	80%
115	GPT-5 Mini	$0.0015	12.3s	20%	100	100	100	100	0	80%
122	Aion 3.0	$0.0047	14.6s	20%	100	100	100	100	0	80%
119	o4 Mini High	$0.0040	12.7s	20%	100	100	100	100	0	80%
121	MiniMax M2.5	$0.0025	40.2s	20%	100	100	100	100	0	80%
120	Xiaomi MIMO v2.5 Pro	$0.0037	18.6s	20%	100	100	100	100	0	80%
117	Qwen 3.5 Flash	$0.0017	29.1s	20%	100	100	100	100	0	80%
103	Gemini 3 Flash (Preview)	$0.0003	1.2s	20%	100	100	100	100	0	80%
125	Gemini 2.5 Flash (Reasoning)	$0.0072	13.3s	20%	100	100	100	100	0	80%
123	Aion 3.0 Mini	$0.0031	51.9s	20%	100	100	100	100	0	80%
109	Claude Haiku 4.5	$0.0008	2.0s	20%	100	100	100	100	0	80%
116	Gemini 2.5 Flash Lite (Reasoning)	$0.0010	33.3s	20%	100	100	100	100	0	80%
110	DeepSeek V4 Flash	$0.0000	16.9s	20%	100	100	100	100	0	80%
106	GPT-4.1 Mini	$0.0004	3.3s	20%	100	100	100	100	0	80%
102	Gemini 2.5 Flash	$0.0002	796ms	20%	100	100	100	100	0	80%
112	GPT-5 Nano	$0.0006	17.3s	20%	100	100	100	100	0	80%
100	Gemini 2.5 Flash Lite	$0.0001	735ms	20%	100	100	100	100	0	80%
113	Qwen 3 32B	$0.0005	20.3s	20%	100	100	100	100	0	80%
114	Writer: Palmyra X5	$0.0016	5.6s	20%	100	100	100	100	0	80%
111	Qwen3 235B A22B Instruct 2507	$0.0002	15.7s	20%	100	100	100	100	0	80%
104	Grok 4.3	$0.0003	1.1s	20%	100	100	100	100	0	80%
107	GPT-5.4 Nano (Reasoning, Low)	$0.0004	4.0s	20%	100	100	100	100	0	80%
105	Thinking Machines Inkling	$0.0003	1.7s	20%	100	100	100	100	0	80%
101	Cydonia 24B V4.1	$0.0001	2.7s	20%	100	100	100	100	0	80%
108	WizardLM 2 8x22b	$0.0003	6.3s	20%	100	100	100	100	0	80%
99	Mistral NeMO	$0.0000	440ms	20%	100	100	100	100	0	80%
131	GPT-5.6 Sol	$0.0017	1.2s	2%	100	100	100	0	0	60%
132	GPT-5.4	$0.0020	2.2s	2%	100	100	100	0	0	60%
130	Xiaomi MIMO v2.5	$0.0012	6.3s	2%	100	100	100	0	0	60%
128	Inception Mercury 2	$0.0005	1.0s	2%	100	100	100	0	0	60%
127	GPT-5.4 Mini	$0.0001	685ms	2%	100	100	100	0	0	60%
129	Nemotron 3 Nano	$0.0002	10.9s	2%	100	100	100	0	0	60%
126	Gemma 3 4B	$0.0000	2.0s	2%	100	100	100	0	0	60%
143	Qwen 3.6 Flash	$0.0028	9.6s	0%	100	100	0	0	0	40%
161	DeepSeek V4 Pro (Reasoning)	$0.018	8.9m	0%	100	100	0	0	0	40%
141	o4 Mini	$0.0020	5.2s	0%	100	100	0	0	0	40%
140	Nemotron 3 Super	$0.0000	12.1s	0%	100	100	0	0	0	40%
138	Grok 4.20	$0.0002	862ms	0%	100	100	0	0	0	40%
136	GPT-5.4 Nano	$0.0001	1.1s	0%	100	100	0	0	0	40%
139	ByteDance Seed 1.6 Flash	$0.0003	6.0s	0%	100	100	0	0	0	40%
135	GPT-4.1 Nano	$0.0000	1.6s	0%	100	100	0	0	0	40%
137	Arcee AI: Trinity Mini	$0.0001	2.6s	0%	100	100	0	0	0	40%
142	Cohere Command R+ (Aug. 2024)	$0.0027	5.5s	0%	100	100	0	0	0	40%
134	Ministral 8B	$0.0000	354ms	0%	100	100	0	0	0	40%
133	Ministral 3B	$0.0000	309ms	0%	100	100	0	0	0	40%
147	GPT-4o, Aug. 6th (temp=1)	$0.0006	1.3s	0%	100	0	0	0	0	20%
145	Llama 3.1 70B	$0.0002	3.4s	0%	100	0	0	0	0	20%
146	Laguna XS 2.1	$0.0002	7.5s	0%	100	0	0	0	0	20%
144	Hermes 3 70B	$0.0001	3.2s	0%	100	0	0	0	0	20%
158	GPT-4o, Aug. 6th (temp=0)	$0.0006	1.7s	0%	0	0	0	0	0	0%
160	DeepSeek V4 Pro	$0.0002	19.8s	0%	0	0	0	0	0	0%
159	Mistral Small 4 (Reasoning)	$0.0007	8.1s	0%	0	0	0	0	0	0%
150	GPT-4o Mini (temp=1)	$0.0000	923ms	0%	0	0	0	0	0	0%
153	Mistral Small 3.2 24B	$0.0001	3.2s	0%	0	0	0	0	0	0%
151	GPT-4o Mini (temp=0)	$0.0000	1.0s	0%	0	0	0	0	0	0%
157	Mistral Medium 3.1	$0.0004	2.8s	0%	0	0	0	0	0	0%
154	Gemma 3 12B	$0.0000	4.2s	0%	0	0	0	0	0	0%
156	Gemma 3 27B	$0.0001	7.2s	0%	0	0	0	0	0	0%
152	Mistral Small 4	$0.0001	1.2s	0%	0	0	0	0	0	0%
155	Qwen 2.5 72B	$0.0001	3.4s	0%	0	0	0	0	0	0%
149	Ministral 3 14B	$0.0000	816ms	0%	0	0	0	0	0	0%
148	Ministral 3 8B	$0.0000	729ms	0%	0	0	0	0	0	0%
80.50%