Run: 2026-02-20-01KHYAB7N5FCXKFWZ0RK9A66VW

Run Details

Model:
Grok 4.1 Fast
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
13.5s
Cost:
$0.000620
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
77.78% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: *looking troubled at her camera, muttering to herself* Mon Dieu... qu'est-ce que j'ai vu... Hunter: Excuse me, miss. I'm Detective Hunter. I understand you're a visitor here in Alborn. Did you happen to see anything unusual at the apple festival last night? Around the time Ms. Jenkins went missing? Marie: *shaken, eyes wide, speaking rapidly in French* Oui! Oui, j'ai photographié quelque chose... un homme avec un manteau noir, il tirait quelqu'un vers les bois près du stand de pommes! C'était horrible, il faisait sombre... Hunter: *confused frown* Uh... I'm sorry, I don't speak French. Do you understand any English at all? Parlez anglais? Marie: *frantic, shaking her head, pointing at her camera* Non, non anglais! Regardez! *shows him a blurry photo on the camera screen* Là, l'homme! Danger! Hunter: *leaning in, puzzled, trying to interpret* Okay... a man? In a black coat? *mimes pulling someone* Like this? Towards the woods by the apple stand? Marie: *nodding vigorously, voice trembling* Exactement! Il a enlevé quelqu'un, je le jure! Aidez-moi, s'il vous plaît! Hunter: Alright, that's helpful. Stay here, I'll get an interpreter or— *phone rings* Hold on. *answers* Hunter here... Yeah? Now? Damn. *to Marie* Excuse me, I gotta run. Don't leave town, okay? We'll talk more! Marie: *calling after him anxiously* Attendez! Monsieur!
created_at"2026-02-20T20:02:34.802Z" 2/20/2026, 8:02:34 PM
model"x-ai/grok-4.1-fast"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency205
moderation_latency(null)
generation_time13325
tokens_prompt316
tokens_completion461
native_tokens_prompt413
native_tokens_completion1198
native_tokens_completion_images0
native_tokens_reasoning864
native_tokens_cached412
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.0006198
router(null)
provider_responses
0
endpoint_id"9821aa0e-dce3-4c27-9716-161359123d0b"
id"f805174d-581c-371a-eb89-32216fcabadb"
is_byokfalse
latency61
model_permaslug"x-ai/grok-4.1-fast"
provider_name"xAI"
status200
api_type"completions"
id"gen-1771617754-SSa65GupMJzqt5SfajCr"
upstream_id"f805174d-581c-371a-eb89-32216fcabadb"
total_cost0.0006198
cache_discount0.0000618
upstream_inference_cost0
provider_name"xAI"

Evaluation details

Result Evaluator Details Meta Data
77.78% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"looking troubled at her camera, muttering to herself Mon Dieu... qu'est-ce que j'ai vu..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.6916890080428955
en0.6838922484881804
no0.5570107858243452
da0.5355411954765752
tl0.4875222816399288
nl0.4748858447488585
de0.4570349386213409
ro0.3837084673097535
ca0.37971952535059333
es0.37295528898582336
sv0.3646408839779005
pt0.3443557582668187
it0.339080459770115
fi0.27944862155388467
ms0.27944862155388467
sk0.2493472584856397
cs0.2483660130718954
tr0.24242424242424243
lv0.23941798941798942
sl0.23841059602649006
hr0.23333333333333334
lt0.22506738544474394
sq0.20249653259361997
yo0.19241573033707865
pl0.19014084507042253
hi0.11944869831546708
eu0.11128284389489954
is0.10990712074303406
et0.0987460815047022
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter. I understand you're a visitor here in Alborn. Did you happen to see anything unusual at the apple festival last night? Around the time Ms. Jenkins went missing?"
detectedLang"en"
heavyLang"en"
scores
en0.7901156344051956
tl0.6320466537073035
da0.5570043463724507
no0.5525160418777441
nl0.5132255694342396
it0.4600651996740016
fr0.4596247960848287
sv0.45874183006535946
pt0.4435111297774044
de0.4387971198644642
sq0.4273984442523769
es0.42590987868284225
ro0.42139737991266374
ca0.3988203266787659
et0.38429368029739774
ms0.3773496240601504
cs0.37322611163670766
hr0.37233538607295125
sl0.3663318986131038
sk0.3184156378600823
yo0.31595250387196694
pl0.30845511482254695
lt0.25728699551569506
lv0.23277359583092067
az0.2318840579710145
hu0.22469280280866005
is0.21551213735938426
fi0.17394014962593518
tr0.13455258001306336
vi0.09122085048010975
be0.05017921146953405
eu0.05017921146953405
uk0.045389048991354465
reliabletrue
passestrue
2
name"Marie"
dialogue"shaken, eyes wide, speaking rapidly in French Oui! Oui, j'ai photographié quelque chose... un homme avec un manteau noir, il tirait quelqu'un vers les bois près du stand de pommes! C'était horrible, il faisait sombre..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7600349040139616
en0.6021412037037037
it0.4560917721518987
ca0.4550138723741577
tl0.4181125687685146
es0.3966652040368583
ro0.38396057347670254
no0.3495742667928098
nl0.33671008200675356
de0.3203163618388532
da0.3041497975708502
pt0.289405684754522
sv0.28830227743271225
az0.2763157894736842
eu0.22228506787330315
tr0.19070041200706297
yo0.17318099819603128
ms0.17118746232670284
et0.16717141126589946
lv0.15436654366543665
lt0.14965986394557826
sl0.14276807980049877
sq0.13901064495929868
is0.13358538122243227
pl0.10830090791180284
vi0.06716417910447761
hu0.06589673913043478
hr0.05628002745367193
fi0.053682037164487266
hi0.05303030303030303
cs0.05172413793103448
sk0.0497581202487906
reliabletrue
passestrue
3
name"Hunter"
dialogue"confused frown Uh... I'm sorry, I don't speak French. Do you understand any English at all? Parlez anglais?"
detectedLang"en"
heavyLang"en"
scores
en0.7737556561085973
tl0.5616598480420807
no0.5219885277246654
da0.49866310160427807
sv0.423963133640553
it0.4235203689469639
cs0.419953596287703
ca0.410377358490566
pt0.4094488188976378
ro0.3907392363931763
sq0.3842364532019704
sk0.36655405405405406
pl0.3556701030927836
de0.34782608695652173
hr0.3444055944055944
et0.3273542600896861
fr0.3212669683257918
nl0.2937853107344633
lt0.27466150870406186
sl0.2596248766041461
es0.258160237388724
lv0.22360248447204967
vi0.1883116883116883
yo0.18032786885245902
is0.1544532130777903
ms0.15254237288135594
hu0.1515837104072398
az0.1506228765571914
tr0.14675767918088736
be0.08536585365853659
uk0.07749077490774908
reliabletrue
passestrue
4
name"Marie"
dialogue"frantic, shaking her head, pointing at her camera Non, non anglais! Regardez! shows him a blurry photo on the camera screen Là, l'homme! Danger!"
detectedLang"en"
heavyLang"en"
scores
en0.7561315496098104
fr0.6737509321401938
tl0.6612466124661246
no0.5265151515151516
da0.4852941176470589
nl0.4769874476987448
ca0.4703389830508474
it0.45550715619166154
ro0.4281045751633987
sv0.38249823570924485
de0.3566176470588235
yo0.34895833333333337
es0.3406179351921628
cs0.3371212121212121
lt0.32117920868890615
et0.30389817024661897
ms0.29321486268174474
pl0.28629690048939643
pt0.28454619787408014
sk0.28454619787408014
hr0.28219852337981954
sq0.2622259696458685
fi0.25341296928327645
is0.24242424242424243
tr0.2324561403508772
sl0.21875
eu0.21312949640287768
vi0.20598911070780399
hu0.2052679382379655
lv0.20309653916211293
hi0.15540540540540537
az0.13194444444444445
reliabletrue
passesfalse
5
name"Hunter"
dialogue"leaning in, puzzled, trying to interpret Okay... a man? In a black coat? mimes pulling someone Like this? Towards the woods by the apple stand?"
detectedLang"en"
heavyLang"en"
scores
en0.7811405702851426
tl0.6247855917667238
da0.5603015075376884
de0.5456905503634476
no0.5421245421245421
nl0.5226404800872886
fr0.5136186770428015
sv0.4852941176470589
pl0.4510664993726474
it0.403544648943422
ro0.4015047879616963
cs0.3842364532019704
sk0.38380281690140844
es0.37722419928825623
sl0.37275985663082434
pt0.3460388639760837
yo0.3401206636500754
ms0.33510638297872336
lt0.3222308288148722
ca0.3099369085173501
hr0.3099369085173501
lv0.3061062648691515
az0.30500397140587765
sq0.2926434923201294
is0.2714404662781016
hu0.2052679382379655
tr0.19798350137488543
eu0.14800389483933787
et0.13194444444444445
vi0.13194444444444445
fi0.06716417910447761
reliabletrue
passestrue
6
name"Marie"
dialogue"nodding vigorously, voice trembling Exactement! Il a enlevé quelqu'un, je le jure! Aidez-moi, s'il vous plaît!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.7050727487219819
en0.5384615384615384
it0.46120689655172414
ro0.4369369369369369
nl0.4028662420382166
sl0.3902439024390244
yo0.3837304847986853
ca0.3816982687551525
sk0.35344827586206895
es0.35177182368193605
tl0.3415276558384548
de0.33745583038869253
hr0.31569343065693434
cs0.3131868131868132
no0.3087557603686636
da0.30683918669131244
hu0.2970946579194002
pt0.2829827915869981
ms0.26035502958579887
pl0.2596248766041461
az0.24849699398797598
sv0.23076923076923078
eu0.19268030139935413
ja0.19181034482758622
tr0.17672886937431392
is0.1638795986622074
sq0.156355455568054
lt0.0985576923076923
lv0.08536585365853659
vi0.08536585365853659
et0.07749077490774908
fi0.07749077490774908
reliabletrue
passestrue
7
name"Hunter"
dialogue"Alright, that's helpful. Stay here, I'll get an interpreter or— phone rings Hold on. answers Hunter here... Yeah? Now? Damn. to Marie Excuse me, I gotta run. Don't leave town, okay? We'll talk more!"
detectedLang"en"
heavyLang"en"
scores
en0.7514204545454546
tl0.4908561928512053
da0.4615384615384615
no0.4403837368661489
fr0.43807339449541277
it0.41275167785234906
de0.4090689821514713
sq0.40039158100832106
sv0.3813131313131313
nl0.3639667705088266
yo0.33926645091693636
ca0.3346007604562738
et0.32766190998902306
ro0.32655305112699284
hr0.3209534368070953
sl0.3171683389074693
ms0.293133294864397
fi0.2877906976744186
pl0.28737638161721935
sk0.2832065535400819
es0.27898763978811064
pt0.2695289206917114
cs0.2673444976076555
tr0.25030599755201954
vi0.23101067168863781
hu0.2127249357326478
lv0.21221864951768488
lt0.20247395833333334
is0.1700542005420054
eu0.1689280868385346
az0.09594095940959409
hi0.0641711229946524
be0.05405405405405406
uk0.04891304347826087
reliabletrue
passestrue
8
name"Marie"
dialogue"calling after him anxiously Attendez! Monsieur!"
detectedLang"en"
heavyLang"en"
scores
en0.7411242603550295
fr0.6376811594202898
no0.5518565941101152
da0.5466321243523317
sv0.4590417310664606
tl0.4444444444444444
es0.4290375203915171
de0.41666666666666663
nl0.35779816513761464
it0.34210526315789475
ca0.3027888446215139
ms0.22048997772828507
pt0.19540229885057472
lv0.1784037558685446
et0.1566265060240964
tr0.1566265060240964
reliabletrue
passesfalse