Run: 2026-02-20-01KHY8J6VFKJ468EYZK9ZMT2FA

Run Details

Model:
Gemma 3 27B
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
30.3s
Cost:
$0.000155
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
## Scene: Alborn Cafe - Voice Sheet **Setting:** A cozy, slightly worn cafe in Alborn, Minnesota. Afternoon light streams through the windows. The aroma of coffee and apple pie hangs in the air. **Characters:** Melanie (30, German student, photographer), Hunter (35, Detective) --- **Melanie:** (Softly, fiddling with her camera, muttering under her breath) …Unfassbar… einfach unbegreiflich… (Unbelievable… simply incomprehensible…) **Hunter:** (Approaching her table, a weary look on his face) Excuse me, miss? You wouldn’t happen to be new around here, would you? I haven’t seen your face before. **Melanie:** (Looks up, startled. Her eyes are wide and filled with distress. She replies quickly, in German, her voice trembling) Was wollen Sie? Ich… ich verstehe nicht, was hier passiert. Es ist schrecklich! (What do you want? I… I don’t understand what’s happening here. It’s terrible!) **Hunter:** (Frowning, tilting his head slightly) Sorry? I… I didn’t catch that. English? Do you speak English? **Melanie:** (Shakes her head vigorously, clutching her camera tighter) Nein! Ich spreche kein Englisch! Deutsch! Ich bin aus Deutschland! (No! I don’t speak English! German! I’m from Germany!) **Hunter:** (Sighs, rubbing the back of his neck) Germany, huh? Look, I'm Detective Hunter. I’m looking into… well, a couple of people have gone missing recently. And everyone's talking about the old Miller place. You happen to be near there yesterday? Taking pictures, maybe? **Melanie:** (Her eyes well up with tears. She speaks rapidly, gesturing with her hands) Ja, ich war dort. Um Fotos zu machen. Aber… aber ich habe etwas gesehen! Eine Gestalt… im Wald… Es war furchtbar! (Yes, I was there. To take pictures. But… but I saw something! A figure… in the forest… It was terrible!) **Hunter:** (Confused, holding up his hands) Whoa, slow down. A figure? What kind of figure? Look, I’m trying to help, but I can’t understand a word you’re saying. **Melanie:** (Frustrated, pointing at the camera) Ich habe es fotografiert! Vielleicht… vielleicht kann das Foto helfen. (I photographed it! Perhaps… perhaps the photo can help.) **Hunter:** (Gesturing at the camera) Let me see… okay. But I still need to know what you mean… this disappearance… you saw someone? (He leans forward, trying to decipher her expression.) **Melanie:** (Shakes her head, still distressed) Nicht *jemanden*. Etwas… Böses. Etwas Dunkles. (Not *someone*. Something… evil. Something dark.) **(Hunter's radio crackles to life)** **Hunter (into radio):** Hunter here. …Yeah, got a lead… **(He listens for a moment, his face hardening)** **Hunter:** (To Melanie, apologetically) Gotta go. Looks like we’ve got an update on one of the cases. Listen, I… I’m really sorry, but I need to take this. (He reaches for a business card) Maybe… maybe someone at the college can help translate? **Melanie:** (Looking defeated, manages a small, trembling nod) Ja… vielleicht. (Yes… perhaps.) **Hunter:** (Hands her the card) Call me if you find someone who can help. And… try to stay safe. (He turns and heads for the door, speaking into his radio) Hunter out. ---
created_at"2026-02-20T19:31:26.2Z" 2/20/2026, 7:31:26 PM
model"google/gemma-3-27b-it"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency893
moderation_latency(null)
generation_time30183
tokens_prompt343
tokens_completion858
native_tokens_prompt296
native_tokens_completion820
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00015488
router(null)
provider_responses
0
endpoint_id"8f22002c-c045-446f-a1b9-9896133536b8"
id"chatcmpl-R5La8FIfkpfvcSmZygRg7dBA"
is_byokfalse
latency81
model_permaslug"google/gemma-3-27b-it"
provider_name"DeepInfra"
status200
api_type"completions"
id"gen-1771615886-h2Iw9NwHXDavlWquniSN"
upstream_id"chatcmpl-R5La8FIfkpfvcSmZygRg7dBA"
total_cost0.00015488
cache_discount(null)
upstream_inference_cost0
provider_name"DeepInfra"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Melanie"
dialogue"…Unfassbar… einfach unbegreiflich…"
detectedLang"de"
heavyLang"de"
scores
de0.7538293216630197
is0.34782608695652173
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss? You wouldn’t happen to be new around here, would you? I haven’t seen your face before."
detectedLang"en"
heavyLang"en"
scores
en0.8148696682464455
tl0.6051800379027164
no0.5158791634391944
da0.47257383966244726
sv0.4196843082636954
sq0.41369606003752346
yo0.388454011741683
cs0.37374749498997994
hu0.3615934627170583
nl0.3372216330858961
hr0.3343982960596379
lt0.3086283185840708
sl0.30011198208286677
sk0.2961711711711712
pl0.2945823927765237
ro0.2945823927765237
it0.2889647326507395
fr0.284077892325315
pt0.284077892325315
ca0.27409988385598144
ms0.26122931442080377
lv0.22839506172839508
et0.20178799489144317
de0.19146183699870634
es0.14030261348005504
fi0.10714285714285714
be0.10071942446043164
tr0.10071942446043164
az0.09156976744186046
is0.09156976744186046
uk0.09156976744186046
vi0.09156976744186046
reliabletrue
passestrue
2
name"Melanie"
dialogue"Was wollen Sie? Ich… ich verstehe nicht, was hier passiert. Es ist schrecklich!"
detectedLang"de"
heavyLang"de"
scores
de0.844139650872818
nl0.6153846153846154
en0.42263279445727486
no0.4033412887828162
ca0.38800489596083226
it0.3514915693904021
hu0.34895833333333337
fr0.33244325767690247
sv0.3270524899057874
pl0.31224209078404397
es0.29577464788732394
da0.251497005988024
lt0.251497005988024
pt0.25037481259370314
is0.20886075949367086
sq0.20634920634920634
sk0.19871794871794873
lv0.1935483870967742
hi0.1749174917491749
cs0.16666666666666666
tr0.15824915824915825
yo0.1482112436115843
fi0.13793103448275862
et0.11504424778761062
ms0.11504424778761062
az0.10554561717352416
ro0.10554561717352416
reliabletrue
passestrue
3
name"Hunter"
dialogue"Sorry? I… I didn’t catch that. English? Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8131539611360238
tl0.644212523719165
hr0.4688385269121813
cs0.4573082489146165
sv0.44526627218934917
it0.4360902255639098
pl0.41770186335403725
pt0.40570522979397783
sq0.4009584664536741
no0.37707641196013286
da0.36006825938566556
sk0.35233160621761656
vi0.3169398907103825
tr0.3119266055045872
yo0.3055555555555556
ro0.30167597765363136
de0.2816091954022989
ca0.2690058479532163
sl0.24242424242424243
fr0.19527896995708155
ms0.1610738255033557
be0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
et0.14383561643835618
is0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
4
name"Melanie"
dialogue"Nein! Ich spreche kein Englisch! Deutsch! Ich bin aus Deutschland!"
detectedLang"de"
heavyLang"de"
scores
de0.8226950354609929
nl0.5897155361050328
no0.4140625
sk0.4075829383886255
en0.39710610932475876
ms0.39222042139384117
da0.3872549019607844
sv0.32432432432432434
ro0.3206521739130435
is0.2870722433460076
hr0.28435114503816794
it0.2632612966601179
pl0.23469387755102045
sl0.22680412371134018
ca0.21052631578947367
yo0.19700214132762314
lt0.1935483870967742
tr0.19006479481641467
tl0.17218543046357618
sq0.14772727272727273
reliabletrue
passestrue
5
name"Hunter"
dialogue"Germany, huh? Look, I'm Detective Hunter. I’m looking into… well, a couple of people have gone missing recently. And everyone's talking about the old Miller place. You happen to be near there yesterday? Taking pictures, maybe?"
detectedLang"en"
heavyLang"en"
scores
en0.8204722492697177
tl0.6180735370274469
fr0.5048674051695199
da0.45931085043988273
de0.44171082513247545
nl0.4412878787878788
no0.44107616521409626
ca0.4085805934242181
sv0.3944991789819376
ro0.38103231221149814
yo0.3171296296296296
pt0.31331471135940414
it0.30293005671077505
cs0.29627862595419846
es0.2636045931103345
is0.24358974358974358
sl0.2420349434737924
hu0.23614707405489382
sq0.23416407061266872
pl0.22286617492096944
sk0.21165152324959915
et0.21122994652406418
tr0.20911528150134048
lt0.19662309368191722
hr0.19530823786142934
ms0.17366946778711487
az0.1685456595264938
fi0.1671372106154715
lv0.15714285714285714
eu0.045307443365695796
vi0.045307443365695796
reliabletrue
passestrue
6
name"Melanie"
dialogue"Ja, ich war dort. Um Fotos zu machen. Aber… aber ich habe etwas gesehen! Eine Gestalt… im Wald… Es war furchtbar!"
detectedLang"de"
heavyLang"de"
scores
de0.8153073286052008
ca0.4323342415985468
pt0.42555147058823534
sk0.37624750499001997
es0.3718592964824121
lv0.37122736418511065
pl0.3602865916069601
sv0.3482794577685088
nl0.3329775880469584
da0.33226495726495725
en0.3055555555555556
no0.28815489749430523
fr0.2807825086306099
fi0.27829099307159355
is0.27409988385598144
lt0.2724097788125727
et0.2577197149643705
hr0.2128463476070529
it0.1925064599483204
sl0.19041450777202074
sq0.18086500655307994
ro0.17218543046357618
eu0.15540540540540537
hu0.14030261348005504
tl0.10714285714285714
yo0.10714285714285714
tr0.10071942446043164
cs0.09682080924855492
az0.08625730994152046
reliabletrue
passestrue
7
name"Hunter"
dialogue"Whoa, slow down. A figure? What kind of figure? Look, I’m trying to help, but I can’t understand a word you’re saying."
detectedLang"en"
heavyLang"en"
scores
en0.8135322322855622
tl0.576271186440678
no0.5283018867924528
da0.4945848375451264
de0.4117647058823529
yo0.3944636678200692
cs0.39236111111111116
nl0.39236111111111116
ro0.39130434782608703
pl0.38811188811188807
sk0.3766696349065004
sv0.37050359712230213
hr0.3439550140581068
fr0.3346007604562738
ca0.33396764985727884
it0.30624380574826565
is0.3006993006993007
sq0.28789420142421157
lv0.2670157068062827
lt0.2623814541622761
tr0.2608236536430834
hu0.24160346695557963
sl0.23161361141602635
pt0.2299229922992299
es0.22308546059933407
az0.15966386554621848
vi0.15966386554621848
et0.15254237288135594
be0.09090909090909091
eu0.09090909090909091
fi0.08256880733944955
ms0.08256880733944955
uk0.08256880733944955
reliabletrue
passestrue
8
name"Melanie"
dialogue"Ich habe es fotografiert! Vielleicht… vielleicht kann das Foto helfen."
detectedLang"de"
heavyLang"de"
scores
de0.8235294117647058
nl0.5410036719706242
ca0.5358910891089109
no0.5046235138705416
pt0.4806094182825485
sk0.4673295454545454
es0.4665718349928876
lv0.4485294117647059
pl0.4444444444444444
fi0.39320388349514557
lt0.36655405405405406
sl0.36332767402376914
hr0.34325744308231176
cs0.3397887323943662
it0.33510638297872336
da0.3339253996447602
ro0.33035714285714285
et0.32553956834532377
sq0.2647058823529412
tr0.25595238095238093
sv0.23935091277890466
hu0.21383647798742136
is0.17218543046357618
az0.1359447004608295
en0.1359447004608295
fr0.1359447004608295
ms0.1359447004608295
reliabletrue
passestrue
9
name"Hunter"
dialogue"Let me see… okay. But I still need to know what you mean… this disappearance… you saw someone?"
detectedLang"en"
heavyLang"en"
scores
en0.8082955733705124
tl0.5192307692307693
cs0.47267497603068076
no0.472168905950096
da0.46131243878550443
et0.4591937069813176
sq0.43064182194616984
it0.4258872651356994
hr0.4092373791621912
sl0.4066882416396979
fr0.39226519337016574
nl0.36416184971098264
sv0.33973589435774315
yo0.33973589435774315
ms0.33894230769230765
sk0.3234932349323493
pl0.32182490752157833
lv0.314214463840399
es0.3064312736443884
lt0.298469387755102
pt0.29032258064516125
is0.2744063324538259
ca0.2005813953488372
de0.19117647058823528
ro0.140625
fi0.12
be0.11290322580645161
tr0.11290322580645161
hu0.1085899513776337
az0.10277324632952692
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
10
name"Melanie"
dialogue"Nicht . Etwas… Böses. Etwas Dunkles."
detectedLang"de"
heavyLang"de"
scores
de0.7865528281750267
nl0.42028985507246375
sk0.3442622950819672
cs0.3333333333333333
reliabletrue
passestrue
11
name"Hunter"
dialogue"Gotta go. Looks like we’ve got an update on one of the cases. Listen, I… I’m really sorry, but I need to take this. Maybe… maybe someone at the college can help translate?"
detectedLang"en"
heavyLang"en"
scores
en0.8088618592528235
tl0.6391076115485563
no0.5360607338675664
it0.4607843137254902
ro0.4222689075630252
da0.41798941798941797
yo0.4092373791621912
de0.40636805180787916
pl0.40347071583514105
hr0.39091915836101887
ca0.3834080717488789
fr0.3778280542986425
nl0.3571011104617183
et0.338544798556825
sv0.3197278911564626
cs0.31077694235588976
lv0.3055555555555556
pt0.30335655478150725
sk0.298469387755102
sl0.29214929214929214
fi0.29032258064516125
sq0.27488464073829927
es0.2542372881355932
tr0.2403314917127072
lt0.2125984251968504
eu0.207492795389049
ms0.2005813953488372
az0.19236417033773862
vi0.19117647058823528
hu0.1881918819188192
is0.16792738275340394
hi0.13860610806577917
be0.05982905982905983
uk0.05417024935511608
reliabletrue
passestrue
12
name"Melanie"
dialogue"Ja… vielleicht."
detectedLang"de"
heavyLang"de"
scores
de0.8417721518987342
fi0.7983870967741935
et0.6062992125984252
nl0.5918367346938775
lv0.5348837209302325
ca0.5215311004784688
sk0.45652173913043476
da0.4444444444444444
pl0.4444444444444444
sl0.4444444444444444
sq0.42857142857142855
sv0.42857142857142855
yo0.42857142857142855
reliabletrue
passestrue
13
name"Hunter"
dialogue"Call me if you find someone who can help. And… try to stay safe. Hunter out."
detectedLang"en"
heavyLang"en"
scores
en0.8312078019504876
tl0.49664429530201337
da0.3885869565217392
no0.3818681318681319
sl0.3732590529247911
nl0.35437589670014347
yo0.3440233236151603
pt0.337260677466863
cs0.3171471927162367
sq0.3150684931506849
es0.2857142857142857
sv0.2741935483870968
fr0.265905383360522
it0.24114671163575044
ms0.24114671163575044
ca0.23208191126279862
tr0.23208191126279862
pl0.23076923076923078
sk0.22680412371134018
lv0.21328671328671328
hr0.2049469964664311
lt0.18772563176895307
et0.17431192660550457
de0.16356877323420074
az0.14611005692599618
fi0.14285714285714285
ro0.11591355599214145
reliabletrue
passestrue