Either/Or composite

Test: Novel outline

Avg. Score

69.2%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	Gemini 2.5 Flash Lite	100.0%	$0.0003	1.0s	100%
2	GPT-5.4 Nano (Reasoning)	100.0%	$0.0008	4.8s	100%
3	Z.AI GLM 4.5	100.0%	$0.0009	8.1s	100%
4	Claude 3.5 Haiku	100.0%	$0.0025	4.9s	100%
5	Z.AI GLM 5 Turbo	100.0%	$0.0030	7.2s	100%
6	Qwen3 235B A22B Instruct 2507	100.0%	$0.0004	16.4s	100%
7	ByteDance Seed 1.6 Flash	100.0%	$0.0010	15.0s	100%
8	Gemini 3 Flash (Preview, Reasoning)	100.0%	$0.0041	6.0s	100%
9	GPT-5.4 (Reasoning, Low)	100.0%	$0.0051	5.3s	100%
10	Qwen 3.5 Plus (2026-02-15)	100.0%	$0.0021	16.3s	100%
11	GPT-5.2	100.0%	$0.0055	6.4s	100%
12	Qwen 3.5 Flash	100.0%	$0.0011	20.6s	100%
13	Writer: Palmyra X5	100.0%	$0.0039	12.4s	100%
14	Grok 4.20 (Beta, Reasoning)	100.0%	$0.0072	4.3s	100%
15	Z.AI GLM 5	100.0%	$0.0032	21.5s	100%
16	MoonshotAI: Kimi K2.5	100.0%	$0.0033	23.3s	100%
17	Aion 2.0	100.0%	$0.0028	24.9s	100%
18	GPT-5.4 (Reasoning)	100.0%	$0.0062	18.8s	100%
19	Z.AI GLM 4.6	100.0%	$0.0023	34.1s	100%
20	GPT-4o, May 13th (temp=0)	100.0%	$0.013	7.2s	100%
21	Qwen 3.5 35B	100.0%	$0.0078	23.2s	100%
22	Gemini 2.5 Pro	100.0%	$0.013	9.0s	100%
23	Qwen 3.5 122B	100.0%	$0.0091	21.8s	100%
24	Claude Sonnet 4.6 (Reasoning)	100.0%	$0.014	9.3s	100%
25	Gemini 3 Pro (Preview)	100.0%	$0.015	8.7s	100%
26	GPT-5.4 Nano (Reasoning, Low)	95.0%	$0.0007	3.2s	70%
27	Gemini 2.5 Flash Lite (Reasoning)	95.0%	$0.0009	5.1s	70%
28	Gemini 3.1 Pro (Preview)	100.0%	$0.016	13.7s	100%
29	Llama 3.1 Nemotron 70B	95.0%	$0.0006	14.0s	70%
30	Claude Opus 4.6 (Reasoning)	100.0%	$0.019	10.4s	100%
31	DeepSeek-V2 Chat	95.0%	$0.0003	17.9s	70%
32	Qwen 3.5 397B A17B	100.0%	$0.0077	48.3s	100%
33	Qwen 3.5 27B	100.0%	$0.0062	59.6s	100%
34	o4 Mini High	95.0%	$0.0054	13.6s	70%
35	MiniMax M2.7	90.0%	$0.0009	11.7s	60%
36	GPT-5 Mini	90.0%	$0.0016	11.1s	60%
37	GPT-5	95.0%	$0.0093	14.9s	70%
38	Mistral Large	85.0%	$0.0037	2.0s	54%
39	GPT-5.4 Mini (Reasoning)	85.0%	$0.0032	5.8s	54%
40	ByteDance Seed 2.0 Lite	95.0%	$0.0039	41.7s	70%
41	Stealth: Hunter Alpha	80.0%	$0.0000	7.5s	51%
42	MiniMax M2.5	85.0%	$0.0010	16.4s	54%
43	Mistral Large 3	90.0%	$0.0012	4.8s	40%
44	Nemotron 3 Super	80.0%	$0.0000	13.6s	51%
45	Gemini 3.1 Flash Lite (Preview)	80.0%	$0.0010	1.7s	34%
46	Z.AI GLM 4.7	90.0%	$0.0029	51.1s	60%
47	GPT-4.1	85.0%	$0.0046	7.3s	36%
48	Gemini 2.5 Flash (Reasoning)	80.0%	$0.0024	3.9s	34%
49	Gemma 3 12B	75.0%	$0.0002	9.5s	38%
50	GPT-4o, Aug. 6th (temp=0)	75.0%	$0.0037	1.1s	38%
51	GPT-5.1	85.0%	$0.0056	9.0s	36%
52	o4 Mini	85.0%	$0.0049	11.6s	36%
53	Qwen 3.5 9B	95.0%	$0.0011	1.5m	70%
54	ByteDance Seed 1.6	80.0%	$0.0034	34.0s	51%
55	GPT-4o Mini (temp=0)	50.0%	$0.0002	1.5s	50%
56	GPT-4o, Aug. 6th (temp=1)	75.0%	$0.0059	3.9s	33%
57	Stealth: Healer Alpha	70.0%	$0.0000	5.0s	25%
58	GPT-4.1 Nano	65.0%	$0.0001	4.1s	27%
59	GPT-4o Mini (temp=1)	60.0%	$0.0003	1.9s	30%
60	Inception Mercury 2	55.0%	$0.0005	836ms	35%
61	Mistral Small 4 (Reasoning)	70.0%	$0.0013	10.5s	25%
62	Qwen 2.5 72B	70.0%	$0.0008	14.9s	25%
63	Mistral Small 4	65.0%	$0.0003	2.8s	18%
64	Qwen 3 32B	75.0%	$0.0010	36.8s	33%
65	Claude Sonnet 4.6	80.0%	$0.0087	3.6s	20%
66	Gemini 2.5 Flash	60.0%	$0.0005	886ms	20%
67	GPT-4.1 Mini	65.0%	$0.0007	5.8s	16%
68	Llama 3.1 70B	70.0%	$0.0012	17.6s	20%
69	GPT-5 Nano	70.0%	$0.0009	26.9s	26%
70	Ministral 3 8B	50.0%	$0.0003	2.3s	28%
71	Claude Sonnet 4	70.0%	$0.0099	5.6s	25%
72	Claude Haiku 4.5	65.0%	$0.0032	3.1s	10%
73	Z.AI GLM 4.7 Flash	70.0%	$0.0010	39.3s	25%
74	Mistral Large 2	50.0%	$0.0048	7.9s	28%
75	ByteDance Seed 2.0 Mini	95.0%	$0.0024	2.3m	70%
76	Claude Opus 4	95.0%	$0.047	11.4s	70%
77	Inception Mercury	40.0%	$0.0001	1.2s	20%
78	Ministral 3 3B	40.0%	$0.0002	1.5s	20%
79	WizardLM 2 8x22b	55.0%	$0.0019	11.7s	15%
80	Mistral Small Creative	40.0%	$0.0003	3.6s	20%
81	Arcee AI: Trinity Mini	35.0%	$0.0002	6.7s	27%
82	Gemini 3 Flash (Preview)	40.0%	$0.0013	1.7s	20%
83	Grok 4.1 Fast	35.0%	$0.0006	7.0s	27%
84	DeepSeek V3.1	55.0%	$0.0005	13.6s	8%
85	Stealth: Aurora Alpha	60.0%	—	937ms	30%
86	GPT-5.4 Nano	45.0%	$0.0006	1.9s	8%
87	DeepSeek V3 (2024-12-26)	55.0%	$0.0008	10.1s	4%
88	DeepSeek V3.2	50.0%	$0.0005	13.5s	11%
89	Hermes 3 70B	55.0%	$0.0006	10.8s	4%
90	Ministral 3B	45.0%	$0.0001	3.9s	8%
91	Grok 4.20 (Beta)	55.0%	$0.0023	13.5s	8%
92	GPT-4o, May 13th (temp=1)	65.0%	$0.014	7.2s	16%
93	Cohere Command R+ (Aug. 2024)	40.0%	$0.0046	2.4s	20%
94	Ministral 3 14B	35.0%	$0.0004	5.0s	18%
95	Hermes 3 405B	30.0%	$0.0000	11.9s	26%
96	GPT-5.4 Mini (Reasoning, Low)	35.0%	$0.0021	3.2s	18%
97	Grok 4	70.0%	$0.017	20.2s	25%
98	LFM2 24B	35.0%	$0.0001	9.9s	18%
99	Gemma 3 27B	40.0%	$0.0002	9.7s	13%
100	Rocinante 12B	35.0%	$0.0005	13.5s	18%
101	Claude Opus 4.5	55.0%	$0.016	4.9s	23%
102	Llama 3.1 8B	35.0%	$0.0002	2.6s	5%
103	Nemotron 3 Nano	35.0%	$0.0005	32.9s	27%
104	Mistral NeMO	35.0%	$0.0003	3.5s	5%
105	GPT-5.4 Mini	25.0%	$0.0013	851ms	13%
106	Claude Sonnet 4.5	50.0%	$0.0094	4.5s	5%
107	Claude 3 Haiku	35.0%	$0.0006	1.6s	0%
108	GPT-5.4	35.0%	$0.0035	2.7s	5%
109	Arcee AI: Trinity Large (Preview)	25.0%	$0.0000	2.1s	0%
110	Grok 4 Fast	25.0%	$0.0005	3.8s	0%
111	Gemma 3 4B	20.0%	$0.0001	3.5s	0%
112	DeepSeek V3 (2025-03-24)	25.0%	$0.0008	9.5s	0%
113	Claude Opus 4.6	40.0%	$0.012	5.5s	0%
114	Ministral 8B	15.0%	$0.0002	8.4s	0%
115	Claude 3.7 Sonnet	20.0%	$0.0062	3.5s	0%
116	Mistral Medium 3.1	10.0%	$0.0013	5.3s	0%
117	Mistral Small 3.2 24B	5.0%	$0.0002	3.0s	0%
118	Claude 3.5 Sonnet	10.0%	$0.0062	5.2s	0%
69.19%

Individual Scenarios

pov-count

▼

Count point of views for Jack and Olivia

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Claude Opus 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5 Turbo	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 122B	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Beta, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 27B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100	100	100	100.0%
Aion 2.0	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Pro	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 35B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.5 Haiku	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen3 235B A22B Instruct 2507	100	100	100	100	100	100	100	100	100	100	100.0%
Writer: Palmyra X5	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100	100	50	95.0%
o4 Mini High	100	100	100	100	100	100	100	100	100	50	95.0%
Claude Opus 4	100	100	100	100	100	100	100	100	100	50	95.0%
ByteDance Seed 2.0 Mini	100	100	100	100	100	100	100	100	100	50	95.0%
Qwen 3.5 9B	100	100	100	100	100	100	100	100	100	50	95.0%
Gemini 2.5 Flash Lite (Reasoning)	100	100	100	100	100	100	100	100	100	50	95.0%
DeepSeek-V2 Chat	100	100	100	100	100	100	100	100	100	50	95.0%
ByteDance Seed 2.0 Lite	100	100	100	100	100	100	100	100	100	50	95.0%
GPT-5.4 Nano (Reasoning, Low)	100	100	100	100	100	100	100	100	100	50	95.0%
Llama 3.1 Nemotron 70B	100	100	100	100	100	100	100	100	100	50	95.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	50	50	90.0%
MiniMax M2.7	100	100	100	100	100	100	100	100	50	50	90.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	50	50	90.0%
Mistral Large 3	100	100	100	100	100	100	100	100	100	0	90.0%
GPT-5.1	100	100	100	100	100	100	100	100	50	0	85.0%
GPT-5.4 Mini (Reasoning)	100	100	100	100	100	100	100	50	50	50	85.0%
MiniMax M2.5	100	100	100	100	100	100	100	50	50	50	85.0%
GPT-4.1	100	100	100	100	100	100	100	100	50	0	85.0%
o4 Mini	100	100	100	100	100	100	100	100	50	0	85.0%
Mistral Large	100	100	100	100	100	100	100	50	50	50	85.0%
Claude Sonnet 4.6	100	100	100	100	100	100	100	100	0	0	80.0%
ByteDance Seed 1.6	100	100	100	100	100	100	50	50	50	50	80.0%
Stealth: Hunter Alpha	100	100	100	100	100	100	50	50	50	50	80.0%
Gemini 2.5 Flash (Reasoning)	100	100	100	100	100	100	100	50	50	0	80.0%
Gemini 3.1 Flash Lite (Preview)	100	100	100	100	100	100	100	50	50	0	80.0%
Nemotron 3 Super	100	100	100	100	100	100	50	50	50	50	80.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	50	50	50	0	75.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	50	50	50	50	50	75.0%
Qwen 3 32B	100	100	100	100	100	100	50	50	50	0	75.0%
Gemma 3 12B	100	100	100	100	100	50	50	50	50	50	75.0%
Claude Sonnet 4	100	100	100	100	100	50	50	50	50	0	70.0%
Grok 4	100	100	100	100	100	50	50	50	50	0	70.0%
Stealth: Healer Alpha	100	100	100	100	100	50	50	50	50	0	70.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	50	50	50	50	0	70.0%
GPT-5 Nano	100	100	100	100	50	50	50	50	50	50	70.0%
Mistral Small 4 (Reasoning)	100	100	100	100	100	50	50	50	50	0	70.0%
Llama 3.1 70B	100	100	100	100	100	100	50	50	0	0	70.0%
Qwen 2.5 72B	100	100	100	100	100	50	50	50	50	0	70.0%
Claude Haiku 4.5	100	100	100	100	100	100	50	0	0	0	65.0%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	50	50	50	0	0	65.0%
GPT-4.1 Mini	100	100	100	100	100	50	50	50	0	0	65.0%
Mistral Small 4	100	100	100	100	50	50	50	50	50	0	65.0%
GPT-4.1 Nano	100	100	100	50	50	50	50	50	50	50	65.0%
Stealth: Aurora Alpha	100	100	50	50	50	50	50	50	50	50	60.0%
Gemini 2.5 Flash	100	100	100	50	50	50	50	50	50	0	60.0%
GPT-4o Mini (temp=1)	100	100	50	50	50	50	50	50	50	50	60.0%
Claude Opus 4.5	100	100	50	50	50	50	50	50	50	0	55.0%
Grok 4.20 (Beta)	100	100	100	100	50	50	50	0	0	0	55.0%
Inception Mercury 2	100	50	50	50	50	50	50	50	50	50	55.0%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	50	0	0	0	0	55.0%
DeepSeek V3.1	100	100	100	100	50	50	50	0	0	0	55.0%
Hermes 3 70B	100	100	100	100	100	50	0	0	0	0	55.0%
WizardLM 2 8x22b	100	100	100	50	50	50	50	50	0	0	55.0%
Claude Sonnet 4.5	100	100	100	100	50	50	0	0	0	0	50.0%
Mistral Large 2	100	50	50	50	50	50	50	50	50	0	50.0%
DeepSeek V3.2	100	100	100	50	50	50	50	0	0	0	50.0%
GPT-4o Mini (temp=0)	50	50	50	50	50	50	50	50	50	50	50.0%
Ministral 3 8B	100	50	50	50	50	50	50	50	50	0	50.0%
GPT-5.4 Nano	100	100	100	50	50	50	0	0	0	0	45.0%
Ministral 3B	100	100	100	50	50	50	0	0	0	0	45.0%
Claude Opus 4.6	100	100	100	100	0	0	0	0	0	0	40.0%
Gemini 3 Flash (Preview)	100	50	50	50	50	50	50	0	0	0	40.0%
Inception Mercury	100	50	50	50	50	50	50	0	0	0	40.0%
Gemma 3 27B	100	100	50	50	50	50	0	0	0	0	40.0%
Mistral Small Creative	100	50	50	50	50	50	50	0	0	0	40.0%
Cohere Command R+ (Aug. 2024)	100	50	50	50	50	50	50	0	0	0	40.0%
Ministral 3 3B	100	50	50	50	50	50	50	0	0	0	40.0%
Grok 4.1 Fast	50	50	50	50	50	50	50	0	0	0	35.0%
GPT-5.4 Mini (Reasoning, Low)	100	50	50	50	50	50	0	0	0	0	35.0%
GPT-5.4	100	100	50	50	50	0	0	0	0	0	35.0%
Nemotron 3 Nano	50	50	50	50	50	50	50	0	0	0	35.0%
Ministral 3 14B	100	50	50	50	50	50	0	0	0	0	35.0%
Claude 3 Haiku	100	100	100	50	0	0	0	0	0	0	35.0%
Arcee AI: Trinity Mini	50	50	50	50	50	50	50	0	0	0	35.0%
Mistral NeMO	100	100	50	50	50	0	0	0	0	0	35.0%
Llama 3.1 8B	100	100	50	50	50	0	0	0	0	0	35.0%
LFM2 24B	100	50	50	50	50	50	0	0	0	0	35.0%
Rocinante 12B	100	50	50	50	50	50	0	0	0	0	35.0%
Hermes 3 405B	50	50	50	50	50	50	0	0	0	0	30.0%
Grok 4 Fast	100	50	50	50	0	0	0	0	0	0	25.0%
GPT-5.4 Mini	50	50	50	50	50	0	0	0	0	0	25.0%
DeepSeek V3 (2025-03-24)	100	50	50	50	0	0	0	0	0	0	25.0%
Arcee AI: Trinity Large (Preview)	100	50	50	50	0	0	0	0	0	0	25.0%
Claude 3.7 Sonnet	100	50	50	0	0	0	0	0	0	0	20.0%
Gemma 3 4B	50	50	50	50	0	0	0	0	0	0	20.0%
Ministral 8B	100	50	0	0	0	0	0	0	0	0	15.0%
Claude 3.5 Sonnet	50	50	0	0	0	0	0	0	0	0	10.0%
Mistral Medium 3.1	50	50	0	0	0	0	0	0	0	0	10.0%
Mistral Small 3.2 24B	50	0	0	0	0	0	0	0	0	0	5.0%

Either/Or composite

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

pov-count

Count point of views for Jack and Olivia