Run: 2026-04-24-01KQ02GJNTTGH8YDGRMVGP8PQ4

Run Details

Model:
GPT-OSS 120B
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
19.7s
Cost:
$0.000147
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Maria: "No sé qué está pasando, la gente dispara, desaparece… me siento muy asustada." Hunter: "Excuse me, I'm sorry, I don't understand." Maria: "¿Has visto a los niños que desaparecieron la semana pasada? Nadie sabe dónde están." Hunter: "I'm looking into those disappearances. Can you tell me what you saw?" Maria: "Todo el día estuvo tranquilo, pero ayer, a la noche, escuché un ruido extraño cerca del granero." Hunter: "A noise at the barn? Can you point?" Maria: "Sí, aquí. Vi luces y sombras moviéndose." Hunter: "Okay, I'll note that. Thank you." Hunter: *phone rings* "Hold on, I have to take this. I'm sorry, I must go." Maria: "Por favor, avísame si encuentras algo. Mi cámara está lista para capturar cualquier pista." Hunter: "I'll do my best. Take care."
created_at"2026-04-24T15:42:39.3Z" 4/24/2026, 3:42:39 PM
model"openai/gpt-oss-120b"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency258
moderation_latency(null)
generation_time19542
tokens_prompt317
tokens_completion796
native_tokens_prompt318
native_tokens_completion707
native_tokens_completion_images(null)
native_tokens_reasoning578
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.000146732
router(null)
provider_responses
0
endpoint_id"85835306-dba3-4334-87bc-ab9ffa5c9c62"
id"chatcmpl-RxiyaSwrr7vw0lvlO90dBYsm"
is_byokfalse
latency78
model_permaslug"openai/gpt-oss-120b"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777045359-ecwdNlC82EVniF2wHroU"
session_id(null)
api_type"completions"
id"gen-1777045359-hj8blFOA31PVXS6pJCAF"
upstream_id"chatcmpl-RxiyaSwrr7vw0lvlO90dBYsm"
total_cost0.000146732
cache_discount(null)
upstream_inference_cost0
provider_name"DeepInfra"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"No sé qué está pasando, la gente dispara, desaparece… me siento muy asustada."
detectedLang"es"
heavyLang"es"
scores
es0.8134328358208955
pt0.7466605251036389
it0.6400523560209423
ca0.6121297602256699
tl0.5266781411359724
ro0.5175438596491229
sq0.49308755760368667
sk0.4751908396946565
fr0.45054945054945056
no0.4416243654822335
lt0.37570942111237227
et0.36562860438292966
en0.3325242718446602
eu0.32432432432432434
ms0.3193069306930693
tr0.31335830212234705
cs0.3125
lv0.29757343550446996
de0.28756476683937826
yo0.2445054945054945
nl0.24242424242424243
da0.2198581560283688
sv0.21428571428571427
pl0.20977011494252876
is0.18276374442793464
hr0.15514592933947774
sl0.13793103448275862
vi0.13249211356466878
fi0.12
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, I'm sorry, I don't understand."
detectedLang"en"
heavyLang"en"
scores
en0.7522708505367465
no0.6398559423769509
da0.5945945945945946
sv0.5377503852080123
it0.4957983193277311
sq0.4845360824742268
nl0.46619217081850534
tl0.4495412844036697
pl0.40476190476190477
de0.39148073022312374
cs0.38650306748466257
pt0.38524590163934425
ro0.35344827586206895
sk0.3492407809110629
et0.34497816593886466
hr0.31662870159453305
ca0.3150684931506849
is0.3135011441647597
es0.2537313432835821
fr0.23273657289002556
sl0.22680412371134018
yo0.2248062015503876
ms0.21875
fi0.2
be0.1891891891891892
tr0.1891891891891892
hu0.18256130790190736
az0.17355371900826447
lt0.17355371900826447
lv0.17355371900826447
uk0.17355371900826447
vi0.17355371900826447
reliabletrue
passestrue
2
name"Maria"
dialogue"¿Has visto a los niños que desaparecieron la semana pasada? Nadie sabe dónde están."
detectedLang"es"
heavyLang"es"
scores
es0.8174649532710281
ca0.6812850586435492
pt0.6687864334923159
fr0.50199203187251
tl0.5011971268954509
it0.47390572390572394
ms0.41697761194029853
ro0.4164332399626517
sk0.3830207305034551
en0.375
lt0.3743743743743744
fi0.32795698924731176
sq0.3228602383531961
cs0.3146929824561403
hu0.3131868131868132
eu0.2905788876276958
hr0.28977272727272724
lv0.2807825086306099
no0.27409988385598144
tr0.26297169811320753
yo0.25239234449760767
sl0.22166874221668745
pl0.21972534332084895
vi0.19768934531450577
az0.19146183699870634
is0.19041450777202074
de0.1883116883116883
da0.18725617685305593
et0.17979002624671916
nl0.10071942446043164
sv0.09156976744186046
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm looking into those disappearances. Can you tell me what you saw?"
detectedLang"en"
heavyLang"en"
scores
en0.8148954703832753
fr0.5800395256916996
pt0.42953020134228187
nl0.4064245810055866
ms0.3988684582743989
tl0.38226744186046513
sq0.3684992570579495
ca0.3491577335375191
es0.31006493506493504
no0.29401993355481726
it0.28209459459459457
et0.18269230769230768
sl0.17153996101364524
de0.15841584158415842
cs0.1550695825049702
az0.1533864541832669
tr0.1533864541832669
fi0.15
lv0.14829659318637273
is0.1431451612903226
sv0.1431451612903226
reliabletrue
passestrue
4
name"Maria"
dialogue"Todo el día estuvo tranquilo, pero ayer, a la noche, escuché un ruido extraño cerca del granero."
detectedLang"es"
heavyLang"es"
scores
es0.8017558765222317
ca0.6688741721854304
it0.6450304259634888
pt0.6201844818231145
ro0.576271186440678
fr0.5757575757575758
tl0.5198902606310014
cs0.4152046783625731
de0.3949870354364737
sk0.3799822852081488
yo0.35424354243542433
no0.3524514338575393
sv0.34701492537313433
en0.34148635936030103
sl0.30417495029821073
lv0.3027888446215139
da0.2964824120603015
hu0.2864424057084608
sq0.2864424057084608
nl0.2813141683778234
pl0.25925925925925924
hr0.25690021231422505
vi0.25690021231422505
lt0.2290748898678414
tr0.16666666666666666
eu0.16367980884109917
az0.15560916767189384
et0.1484184914841849
ms0.1484184914841849
is0.0967741935483871
fi0.08256880733944955
reliabletrue
passestrue
5
name"Hunter"
dialogue"A noise at the barn? Can you point?"
detectedLang"en"
heavyLang"en"
scores
en0.7883149872988993
tl0.7096399535423926
da0.6932515337423313
fr0.6736292428198434
no0.622356495468278
sv0.4929006085192698
yo0.4747899159663866
ca0.4600431965442765
cs0.45652173913043476
pl0.44071588366890374
hu0.3842364532019704
nl0.3811881188118812
tr0.3811881188118812
is0.37810945273631835
sq0.375
az0.37027707808564225
ms0.36061381074168797
pt0.358974358974359
ro0.3573264781491003
es0.34554973821989526
sk0.34210526315789475
it0.3333333333333333
hr0.3093922651933701
sl0.2647058823529412
lt0.24698795180722888
eu0.21875
lv0.21875
vi0.21875
de0.21135646687697163
et0.20127795527156547
fi0.20127795527156547
reliabletrue
passestrue
6
name"Maria"
dialogue"Sí, aquí. Vi luces y sombras moviéndose."
detectedLang"es"
heavyLang"es"
scores
es0.7442958300550747
ca0.5631720430107527
it0.459234608985025
pt0.39138576779026213
vi0.37858508604206503
en0.367704280155642
yo0.3128964059196617
da0.30406852248394006
sv0.2995689655172413
no0.2793791574279379
fr0.24418604651162787
pl0.24418604651162787
ro0.24418604651162787
tl0.21875
reliabletrue
passestrue
7
name"Hunter"
dialogue"Okay, I'll note that. Thank you."
detectedLang"en"
heavyLang"en"
scores
en0.7847478474784748
tl0.6179039301310044
vi0.453125
fr0.36363636363636365
cs0.308300395256917
reliabletrue
passestrue
8
name"Hunter"
dialogue"Hold on, I have to take this. I'm sorry, I must go."
detectedLang"en"
heavyLang"en"
scores
en0.82174688057041
tl0.6674057649667406
da0.6259351620947631
pl0.601593625498008
yo0.5562130177514794
hr0.5334370139968896
cs0.5090016366612111
sk0.48186528497409326
no0.45848375451263534
ca0.441340782122905
et0.41972920696324956
it0.4174757281553398
sl0.39879759519038077
lv0.3814432989690722
lt0.3576017130620985
fi0.3333333333333333
sv0.3150684931506849
sq0.3087557603686636
fr0.2665036674816626
pt0.25
ro0.23076923076923078
hi0.21875
be0.1891891891891892
tr0.1891891891891892
hu0.18256130790190736
az0.17355371900826447
is0.17355371900826447
uk0.17355371900826447
vi0.17355371900826447
reliabletrue
passestrue
9
name"Maria"
dialogue"Por favor, avísame si encuentras algo. Mi cámara está lista para capturar cualquier pista."
detectedLang"es"
heavyLang"es"
scores
es0.7891663963671748
pt0.7078651685393259
ca0.5675316034597472
it0.5383522727272727
tl0.49961508852963815
sq0.4897959183673469
ro0.4749596122778676
fr0.4074749316317229
cs0.3890977443609023
sk0.38330170777988615
sl0.37739463601532564
en0.3564356435643564
lt0.327817993795243
tr0.3157894736842105
no0.3062966915688367
sv0.2919389978213508
fi0.2896174863387978
hr0.2571428571428571
yo0.2450638792102207
pl0.24242424242424243
is0.23976608187134502
eu0.21875
hu0.19254658385093168
lv0.18341708542713567
de0.17407878017789072
da0.16020671834625322
ms0.12751677852348994
nl0.09090909090909091
et0.08835904628330996
reliabletrue
passestrue
10
name"Hunter"
dialogue"I'll do my best. Take care."
detectedLang"en"
heavyLang"en"
scores
en0.7800586510263929
tl0.6153846153846154
pl0.6103896103896105
cs0.5934959349593496
sk0.592391304347826
sl0.5689655172413793
ro0.5548961424332344
pt0.5098039215686274
hr0.4444444444444444
sq0.43820224719101125
vi0.42528735632183906
is0.3644067796610169
nl0.3644067796610169
yo0.34210526315789475
no0.336283185840708
reliabletrue
passestrue