Run: 2026-05-10-01KR8XMN99EXGNVGQY47RAY9RS

Run Details

Model:
Grok 4.3
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
4.9s
Cost:
$0.001094
Provider:
xAI

Evaluation summary

Score Evaluator
Details Link
53.33% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Mujhe nahi pata..." Hunter: "Miss, I heard you were at the park yesterday when the incident happened. Can you tell me what you saw?" Selvi: "Main... main sirf apni photo lene chali gayi thi..." Hunter: "Take it slow. Just tell me anything strange you noticed." Selvi: "Voh... ek aadmi tha..." Hunter: "An older man with a hat? Try to give me more details." Selvi: "Mujhe bahut dar lag raha hai... main kuch nahi bol sakti..." Hunter: "You're safe here. Anything you remember could help." Selvi: "Voh admi... ruka nahi... bus chalte chala gaya." Hunter: "Was he carrying anything?" Selvi: "Mujhe kuch samajh nahi aa raha hai... aap kya bol rahe hain?" Hunter: *growls in frustration* Selvi: "Maine kuch galat nahi kiya." Hunter: "I know this is frightening, but—" *Hunter's phone rings, he checks the caller ID and stands* Hunter: "I have to take this. We'll talk later."
created_at"2026-05-10T12:26:21.873Z" 5/10/2026, 12:26:21 PM
model"x-ai/grok-4.3-20260430"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2240
moderation_latency(null)
generation_time4755
tokens_prompt315
tokens_completion236
native_tokens_prompt387
native_tokens_completion271
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached64
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
service_tier"default"
usage0.00109405
router(null)
provider_responses
0
endpoint_id"45623cb8-18e5-4b32-8fc4-85d05439982d"
id"c6750ced-5018-9b91-9f24-5cbe7fb596fc"
is_byokfalse
latency1947
model_permaslug"x-ai/grok-4.3-20260430"
provider_name"xAI"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1778415981-eFjQhGbFfEkBfkTuFSCF"
session_id(null)
api_type"completions"
id"gen-1778415981-xhPEUMpPvTOP2UrOsCsH"
upstream_id"c6750ced-5018-9b91-9f24-5cbe7fb596fc"
total_cost0.00109405
cache_discount0.0000672
upstream_inference_cost0
provider_name"xAI"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
53.33% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Mujhe nahi pata..."
detectedLang"eu"
heavyLang"tl"
scores
eu0.6226415094339622
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Miss, I heard you were at the park yesterday when the incident happened. Can you tell me what you saw?"
detectedLang"en"
heavyLang"en"
scores
en0.8160637645616186
tl0.615877080665813
no0.504541701073493
nl0.49324324324324326
da0.4614003590664273
sq0.4434137291280148
ca0.4174757281553398
fr0.3902439024390244
it0.3617021276595745
ro0.3428258488499452
cs0.33993399339933994
et0.32356257046223225
az0.3220338983050847
sv0.3174061433447099
ms0.30394431554524365
es0.28741092636579574
pt0.26560587515299877
sl0.26560587515299877
sk0.250936329588015
hr0.24812030075187969
pl0.24623115577889448
yo0.24433249370277077
tr0.19678714859437751
hu0.17355371900826447
de0.16897506925207756
lt0.16897506925207756
fi0.1111111111111111
be0.1044776119402985
is0.09502262443438914
lv0.09502262443438914
uk0.09502262443438914
vi0.09502262443438914
reliabletrue
passestrue
2
name"Selvi"
dialogue"Main... main sirf apni photo lene chali gayi thi..."
detectedLang"en"
heavyLang"vi"
scores
en0.609375
fr0.6019108280254777
cs0.39903846153846156
vi0.38271604938271603
da0.29577464788732394
az0.2378048780487805
de0.2378048780487805
sk0.2378048780487805
hi0.23547400611620795
tl0.23547400611620795
reliabletrue
passesfalse
3
name"Hunter"
dialogue"Take it slow. Just tell me anything strange you noticed."
detectedLang"en"
heavyLang"en"
scores
en0.8
tl0.5673671199011124
sq0.5289367429340512
fr0.47368421052631576
no0.445324881141046
lv0.44
et0.42244224422442245
sl0.42052980132450335
it0.4186046511627907
nl0.41666666666666663
ms0.39130434782608703
da0.358974358974359
es0.35304990757855825
sv0.3320610687022901
de0.328214971209213
pt0.31640625
sk0.31640625
cs0.3150684931506849
hr0.20273348519362186
pl0.1822429906542056
ca0.18032786885245902
yo0.1784037558685446
fi0.1764705882352941
ro0.1764705882352941
is0.1606714628297362
lt0.1606714628297362
az0.14425427872860636
tr0.14425427872860636
reliabletrue
passestrue
4
name"Selvi"
dialogue"Voh... ek aadmi tha..."
detectedLang"sq"
heavyLang"vi"
scores
sq0.4834710743801653
tr0.47257383966244726
nl0.4444444444444444
reliablefalse
passesfalse
5
name"Hunter"
dialogue"An older man with a hat? Try to give me more details."
detectedLang"en"
heavyLang"en"
scores
en0.8042505592841164
de0.6592015579357351
da0.6338912133891214
nl0.6220302375809936
no0.6022727272727273
tl0.5308310991957105
sl0.5251017639077341
hr0.5118549511854952
fr0.5104895104895105
yo0.5
lt0.49348769898697536
sv0.4890510948905109
ms0.46564885496183206
es0.46236559139784944
lv0.4615384615384615
ro0.4590417310664606
pt0.45226917057902977
tr0.45054945054945056
sq0.445324881141046
cs0.4290375203915171
sk0.4281045751633987
hu0.41077441077441074
pl0.4067796610169492
it0.36936936936936937
ca0.360146252285192
vi0.3383742911153119
eu0.3320610687022901
et0.3110236220472441
fi0.2827868852459016
is0.1764705882352941
az0.16666666666666666
reliabletrue
passestrue
6
name"Selvi"
dialogue"Mujhe bahut dar lag raha hai... main kuch nahi bol sakti..."
detectedLang"sq"
heavyLang"tl"
scores
sq0.47368421052631576
eu0.32038834951456313
vi0.30966469428007887
de0.3069306930693069
sk0.29718875502008035
et0.28716904276985744
ro0.2677824267782427
lt0.2647058823529412
it0.2222222222222222
en0.22048997772828507
no0.21875
es0.20993227990970656
pt0.20993227990970656
sv0.20993227990970656
fr0.2009132420091324
nl0.18032786885245902
reliablefalse
passesfalse
7
name"Hunter"
dialogue"You're safe here. Anything you remember could help."
detectedLang"en"
heavyLang"en"
scores
en0.8256972111553784
tl0.4712990936555891
ms0.4176372712146422
fr0.37722419928825623
sq0.36363636363636365
yo0.35064935064935066
nl0.34701492537313433
hu0.33586337760910817
no0.32950191570881227
da0.3137254901960784
de0.308300395256917
is0.3055555555555556
sv0.3
sk0.2677824267782427
sl0.2677824267782427
cs0.1822429906542056
et0.1822429906542056
reliabletrue
passestrue
8
name"Selvi"
dialogue"Voh admi... ruka nahi... bus chalte chala gaya."
detectedLang"tl"
heavyLang"tl"
scores
tl0.5508982035928144
eu0.5283018867924528
en0.4668246445497631
lt0.34593023255813954
fr0.30769230769230765
ms0.30769230769230765
no0.29245283018867924
da0.27884615384615385
de0.27884615384615385
cs0.2549668874172185
nl0.2549668874172185
ro0.2549668874172185
sk0.2549668874172185
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Was he carrying anything?"
detectedLang"en"
heavyLang"en"
scores
en0.8104265402843602
tl0.5735607675906184
nl0.5098039215686274
ca0.49874686716791977
yo0.48586118251928023
es0.4708994708994709
de0.3730407523510972
sq0.3333333333333333
pt0.3288590604026846
fi0.3127147766323024
fr0.29328621908127206
it0.29328621908127206
ms0.2805755395683453
reliabletrue
passestrue
10
name"Selvi"
dialogue"Mujhe kuch samajh nahi aa raha hai... aap kya bol rahe hain?"
detectedLang"eu"
heavyLang"tl"
scores
eu0.4640122511485452
et0.4117647058823529
no0.38271604938271603
vi0.30966469428007887
sk0.29718875502008035
fi0.2290748898678414
is0.22566371681415928
it0.2222222222222222
lv0.21700223713646533
tl0.21700223713646533
da0.19724770642201836
sv0.18604651162790697
ms0.16864608076009502
reliablefalse
passesfalse
11
name"Hunter"
dialogue"growls in frustration"
detectedLang"en"
heavyLang"en"
scores
en0.7844827586206896
de0.7107438016528925
nl0.6846846846846848
tl0.684115523465704
sv0.6812386156648452
fr0.6601941747572816
da0.6102449888641426
yo0.5967741935483871
ro0.5535714285714286
it0.5501285347043702
sl0.5489690721649484
pl0.45652173913043476
az0.4496855345911949
no0.4444444444444444
sq0.4318181818181818
fi0.31906614785992216
zh0.3055555555555556
ms0.3
es0.29149797570850206
pt0.29149797570850206
tr0.2857142857142857
lt0.2768595041322314
ca0.2647058823529412
cs0.2647058823529412
eu0.2647058823529412
hr0.2647058823529412
lv0.2647058823529412
sk0.2647058823529412
is0.25213675213675213
reliabletrue
passestrue
12
name"Selvi"
dialogue"Maine kuch galat nahi kiya."
detectedLang"ro"
heavyLang"tl"
scores
ro0.6300211416490487
tl0.5872641509433962
et0.576271186440678
fr0.5430809399477807
eu0.4852941176470589
lv0.48377581120943947
en0.48224852071005914
fi0.48224852071005914
de0.45652173913043476
es0.3027888446215139
ms0.3027888446215139
ca0.3
sv0.3
tr0.3
reliabletrue
passesfalse
13
name"Hunter"
dialogue"I know this is frightening, but—"
detectedLang"en"
heavyLang"en"
scores
en0.8078565328778822
no0.6646795827123696
da0.6153846153846154
nl0.6147260273972602
tl0.609375
sv0.5490981963927856
is0.5408163265306122
hu0.4955156950672646
yo0.4791666666666667
cs0.44306930693069313
lt0.3935309973045822
sk0.3935309973045822
hr0.3818681318681319
ca0.38016528925619836
et0.3784530386740331
sq0.3732590529247911
pl0.358974358974359
it0.3382352941176471
ro0.2857142857142857
fr0.281150159744409
be0.23728813559322032
tr0.23728813559322032
az0.21875
lv0.21875
uk0.21875
vi0.21875
reliabletrue
passestrue
14
name"Hunter"
dialogue"I have to take this. We'll talk later."
detectedLang"en"
heavyLang"en"
scores
en0.8025276461295419
tl0.6719160104986877
da0.659400544959128
no0.5798319327731093
pl0.5741056218057922
hr0.504950495049505
cs0.48559670781893005
sv0.47257383966244726
yo0.47257383966244726
nl0.4553376906318083
sk0.44933920704845814
sl0.44320712694877507
lv0.42528735632183906
lt0.4004796163069544
de0.3842364532019704
ca0.3556701030927836
sq0.34895833333333337
it0.3150684931506849
ro0.2647058823529412
hi0.2331288343558282
fr0.22118380062305293
pt0.22118380062305293
be0.21875
tr0.21875
hu0.21135646687697163
az0.20127795527156547
et0.20127795527156547
is0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue