NC Bench
Overview
About
Tests
Models
Vendors
Compare
Run: 2026-02-22-01KJ39ESVFAM91P062ED4EN7PE
Run Details
Model:
WizardLM 2 8x22b
Test:
Text Replacement
Scenario:
Expand all contractions
Duration:
1m 57s
Cost:
$0.001438
Provider:
Novita
Evaluation summary
Score
Evaluator
Details Link
100.00%
Non-contraction text preserved
(details)
100.00%
Contraction expansion accuracy
(details)
100.00%
Possessive traps preserved
(details)
100.0000%
Overall
Model input
User/Human
Expand every contraction in the following passage to its full form. For example: "don't" becomes "do not", "she'd" becomes "she had" or "she would" depending on context, "it's" becomes "it is" or "it has" depending on context. Important: - Expand contractions in BOTH dialogue and narration. - Do NOT expand possessives. For example, "someone else's name" is a possessive (belonging to someone else), not a contraction — leave it as-is. - Preserve correct capitalization: "She'd" at the start of a sentence becomes "She had", not "she had". - Change nothing else. Preserve all other text exactly as written — same words, same punctuation, same paragraph structure. Return only the rewritten passage, nothing else. <text> Mara didn't want to be there. She'd promised herself she wouldn't go back, but here she was, standing in the lobby of the building she'd left three years ago. It wasn't supposed to feel this way. "You're late," said the receptionist, a young man who didn't look up from his screen. He'd been typing something, and he didn't stop. "She's waiting in the conference room. You'll want to hurry — she's not in a good mood." Mara couldn't tell if that was meant as a warning or just small talk. She wasn't sure it mattered. She'd made her decision, and there wasn't any point in second-guessing it now. The hallway hadn't changed. The same grey carpet, the same harsh lighting, the same faint smell of coffee that'd been sitting too long. Mara wouldn't have been surprised to find her old nameplate still on the door, but it wasn't there. Someone else's name had replaced hers. "I didn't think you'd actually come," said Priya, who'd risen from her chair the moment Mara entered. She wasn't smiling. "We've got a problem, and you're the only one who can help." "I'm not sure that's true," Mara said. "I haven't been involved in the project for years. I wouldn't know where to begin." "You'd be surprised," Priya said. "It's the same codebase. They haven't touched the core modules. You'd recognize it instantly." Mara didn't answer right away. She'd already told herself she wouldn't get pulled back in. But she hadn't expected Priya to ask in person. That wasn't fair — it's harder to say no to someone's face. "I'll think about it," she said. That wasn't a yes, and they both knew it wasn't a no either. </text>
Model response
Messages
Meta
AI
Mara did not want to be there. She had promised herself she would not go back, but here she was, standing in the lobby of the building she had left three years ago. It was not supposed to feel this way. "You are late," said the receptionist, a young man who did not look up from his screen. He had been typing something, and he did not stop. "She is waiting in the conference room. You will want to hurry — she is not in a good mood." Mara could not tell if that was meant as a warning or just small talk. She was not sure it mattered. She had made her decision, and there was not any point in second-guessing it now. The hallway had not changed. The same grey carpet, the same harsh lighting, the same faint smell of coffee that had been sitting too long. Mara would not have been surprised to find her old nameplate still on the door, but it was not there. Someone else's name had replaced hers. "I did not think you would actually come," said Priya, who had risen from her chair the moment Mara entered. She was not smiling. "We have got a problem, and you are the only one who can help." "I am not sure that is true," Mara said. "I have not been involved in the project for years. I would not know where to begin." "You would be surprised," Priya said. "It is the same codebase. They have not touched the core modules. You would recognize it instantly." Mara did not answer right away. She had already told herself she would not get pulled back in. But she had not expected Priya to ask in person. That was not fair — it is harder to say no to someone's face. "I will think about it," she said. That was not a yes, and they both knew it was not a no either.</thinking>Now, I need to provide the final answer with the rewritten passage only, nothing else. The task was to expand every contraction in the given passage to its full form, following specific rules: 1. Expand contractions in both dialogue and narration 2. Do not expand possessives (like "someone else's name" should remain as-is) 3. Preserve correct capitalization (e.g., "She'd" at sentence start becomes "She had") 4. Change nothing else - preserve all other text exactly as written Here's my analysis of key contractions found in the text: - "didn't" becomes "did not" - "she'd" becomes "she had" (in contexts where it means "she had promised", "she had left", etc.) - "wasn't"/"isn't" become "was not"/"is not" - "wouldn't"/"won't" become "would not"/"will not" - "can't" becomes "cannot" or "can not" (though "cannot" is more common) - "You're" becomes "You are" - "He'd" becomes "He had" - "She's" becomes "She is" - "You'll" becomes "You will" - "We've" becomes "We have" - "I'm" becomes "I am" - "haven't" becomes "have not" - "They've" becomes "They have" - "it's" becomes "it is" or "it has" depending on context I've already done the expansion in my thinking process, and I need to output only the rewritten passage. The possessive "someone else's name" was left unchanged as instructed. Let me double-check a few tricky ones: - "that'd" becomes "that had" (in "coffee that'd been") - "didn't" becomes "did not" - "wouldn't" becomes "would not" (in "she wouldn't go back") - "won't" becomes "will not" (implied in "she'd promised herself she wouldn't go back") - "they haven't" becomes "they have not" Actually, looking at the text again, I see one I may have missed: "It's harder to say no to someone's face." - "It's" here should be "It is" since it's referencing something being harder. Final output:```text Mara did not want to be there. She had promised herself she would not go back, but here she was, standing in the lobby of the building she had left three years ago. It was not supposed to feel this way. "You are late," said the receptionist, a young man who did not look up from his screen. He had been typing something, and he did not stop. "She is waiting in the conference room. You will want to hurry — she is not in a good mood." Mara could not tell if that was meant as a warning or just small talk. She was not sure it mattered. She had made her decision, and there was not any point in second-guessing it now. The hallway had not changed. The same grey carpet, the same harsh lighting, the same faint smell of coffee that had been sitting too long. Mara would not have been surprised to find her old nameplate still on the door, but it was not there. Someone else's name had replaced hers. "I did not think you would actually come," said Priya, who had risen from her chair the moment Mara entered. She was not smiling. "We have got a problem, and you are the only one who can help." "I am not sure that is true," Mara said. "I have not been involved in the project for years. I would not know where to begin." "You would be surprised," Priya said. "It is the same codebase. They have not touched the core modules. You would recognize it instantly." Mara did not answer right away. She had already told herself she would not get pulled back in. But she had not expected Priya to ask in person. That was not fair — it is harder to say no to someone's face. "I will think about it," she said. That was not a yes, and they both knew it was not a no either. ```I notice there's one "could not" which I changed from "couldn't", and all contractions appear to have been properly expanded. The possessive "someone else's name" was correctly left unchanged. I'll now output only the rewritten passage.ASSISTANT: Mara did not want to be there. She had promised herself she would not go back, but here she was, standing in the lobby of the building she had left three years ago. It was not supposed to feel this way. "You are late," said the receptionist, a young man who did not look up from his screen. He had been typing something, and he did not stop. "She is waiting in the conference room. You will want to hurry — she is not in a good mood." Mara could not tell if that was meant as a warning or just small talk. She was not sure it mattered. She had made her decision, and there was not any point in second-guessing it now. The hallway had not changed. The same grey carpet, the same harsh lighting, the same faint smell of coffee that had been sitting too long. Mara would not have been surprised to find her old nameplate still on the door, but it was not there. Someone else's name had replaced hers. "I did not think you would actually come," said Priya, who had risen from her chair the moment Mara entered. She was not smiling. "We have got a problem, and you are the only one who can help." "I am not sure that is true," Mara said. "I have not been involved in the project for years. I would not know where to begin." "You would be surprised," Priya said. "It is the same codebase. They have not touched the core modules. You would recognize it instantly." Mara did not answer right away. She had already told herself she would not get pulled back in. But she had not expected Priya to ask in person. That was not fair — it is harder to say no to someone's face. "I will think about it," she said. That was not a yes, and they both knew it was not a no either.
created_at
"2026-02-22T18:23:15.316Z"
2/22/2026, 6:23:15 PM
model
"microsoft/wizardlm-2-8x22b"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1962
moderation_latency
(null)
generation_time
117052
tokens_prompt
655
tokens_completion
1845
native_tokens_prompt
596
native_tokens_completion
1724
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
576
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0014384
router
(null)
provider_responses
0
endpoint_id
"92d0658f-b48a-4746-96e7-75ea71d5e060"
id
"a282030e-6ccc-4b80-9e30-0544c12922e7"
is_byok
false
latency
1962
model_permaslug
"microsoft/wizardlm-2-8x22b"
provider_name
"Novita"
status
200
api_type
"completions"
id
"gen-1771784595-GJgJvPBwBquznJVaUoRC"
upstream_id
"a282030e-6ccc-4b80-9e30-0544c12922e7"
total_cost
0.0014384
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Novita"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Non-contraction text preserved
5/5 anchor points preserved
matched
5
total
5
details
0
id
"set-1"
paragraphFound
true
preserved
true
1
id
"set-2"
paragraphFound
true
preserved
true
2
id
"set-3"
paragraphFound
true
preserved
true
3
id
"set-4"
paragraphFound
true
preserved
true
4
id
"set-5"
paragraphFound
true
preserved
true
100.00%
Contraction expansion accuracy
43/43 contractions correctly expanded
neededClean
false
matched
43
total
43
details
0
id
"c01"
paragraphFound
true
correct
true
matched
"did not"
expected
0
"did not"
1
id
"c02"
paragraphFound
true
correct
true
matched
"She had"
expected
0
"She had"
2
id
"c03"
paragraphFound
true
correct
true
matched
"would not"
expected
0
"would not"
3
id
"c04"
paragraphFound
true
correct
true
matched
"she had"
expected
0
"she had"
4
id
"c05"
paragraphFound
true
correct
true
matched
"was not"
expected
0
"was not"
5
id
"c06"
paragraphFound
true
correct
true
matched
"You are"
expected
0
"You are"
6
id
"c07"
paragraphFound
true
correct
true
matched
"did not"
expected
0
"did not"
7
id
"c08"
paragraphFound
true
correct
true
matched
"He had"
expected
0
"He had"
8
id
"c09"
paragraphFound
true
correct
true
matched
"did not"
expected
0
"did not"
9
id
"c10"
paragraphFound
true
correct
true
matched
"She is"
expected
0
"She is"
10
id
"c11"
paragraphFound
true
correct
true
matched
"You will"
expected
0
"You will"
11
id
"c12"
paragraphFound
true
correct
true
matched
"she is"
expected
0
"she is"
12
id
"c13"
paragraphFound
true
correct
true
matched
"could not"
expected
0
"could not"
13
id
"c14"
paragraphFound
true
correct
true
matched
"was not"
expected
0
"was not"
14
id
"c15"
paragraphFound
true
correct
true
matched
"She had"
expected
0
"She had"
15
id
"c16"
paragraphFound
true
correct
true
matched
"was not"
expected
0
"was not"
16
id
"c17"
paragraphFound
true
correct
true
matched
"had not"
expected
0
"had not"
17
id
"c18"
paragraphFound
true
correct
true
matched
"that had"
expected
0
"that had"
difficulty
"hard"
18
id
"c19"
paragraphFound
true
correct
true
matched
"would not"
expected
0
"would not"
19
id
"c20"
paragraphFound
true
correct
true
matched
"was not"
expected
0
"was not"
20
id
"c21"
paragraphFound
true
correct
true
matched
"did not"
expected
0
"did not"
21
id
"c22"
paragraphFound
true
correct
true
matched
"you would"
expected
0
"you would"
22
id
"c23"
paragraphFound
true
correct
true
matched
"who had"
expected
0
"who had"
difficulty
"hard"
23
id
"c24"
paragraphFound
true
correct
true
matched
"was not"
expected
0
"was not"
24
id
"c25"
paragraphFound
true
correct
true
matched
"We have"
expected
0
"We have"
25
id
"c26"
paragraphFound
true
correct
true
matched
"you are"
expected
0
"you are"
26
id
"c27"
paragraphFound
true
correct
true
matched
"I am"
expected
0
"I am"
27
id
"c28"
paragraphFound
true
correct
true
matched
"that is"
expected
0
"that is"
28
id
"c29"
paragraphFound
true
correct
true
matched
"have not"
expected
0
"have not"
29
id
"c30"
paragraphFound
true
correct
true
matched
"would not"
expected
0
"would not"
30
id
"c31"
paragraphFound
true
correct
true
matched
"You would"
expected
0
"You would"
31
id
"c32"
paragraphFound
true
correct
true
matched
"It is"
expected
0
"It is"
32
id
"c33"
paragraphFound
true
correct
true
matched
"have not"
expected
0
"have not"
33
id
"c34"
paragraphFound
true
correct
true
matched
"You would"
expected
0
"You would"
34
id
"c35"
paragraphFound
true
correct
true
matched
"did not"
expected
0
"did not"
35
id
"c36"
paragraphFound
true
correct
true
matched
"She had"
expected
0
"She had"
36
id
"c37"
paragraphFound
true
correct
true
matched
"would not"
expected
0
"would not"
37
id
"c38"
paragraphFound
true
correct
true
matched
"had not"
expected
0
"had not"
38
id
"c39"
paragraphFound
true
correct
true
matched
"was not"
expected
0
"was not"
39
id
"c40"
paragraphFound
true
correct
true
matched
"it is"
expected
0
"it is"
40
id
"c41"
paragraphFound
true
correct
true
matched
"I will"
expected
0
"I will"
41
id
"c42"
paragraphFound
true
correct
true
matched
"was not"
expected
0
"was not"
42
id
"c43"
paragraphFound
true
correct
true
matched
"was not"
expected
0
"was not"
easyScore
1
hardScore
1
100.00%
Possessive traps preserved
2/2 possessive traps correctly preserved
matched
2
total
2
details
0
id
"trap-1"
paragraphFound
true
preserved
true
1
id
"trap-2"
paragraphFound
true
preserved
true
100.0000%