Model

EVA Qwen 2.5 14B

Test

Voice/dialogue sheets

Scenario

Simple

Run ID

2024-10-01-01J94RHMN2YDDPP6Q14GN6F1HP

Model input

System
You are an editor for novels. Whenever given text, you will extract the contained dialogue as a voice sheet in the following format: Speaker: "Dialogue"
User/Human
“What a curious feeling!” said Alice; “I must be shutting up like a telescope.” “Not like cats!” cried the Mouse, in a shrill, passionate voice. “Would you like cats if you were me?” “Come, there’s no use in crying like that!” said Alice to herself, rather sharply; “I advise you to leave off this minute!”

Model response

AI
[Rabbit] “What a hurry she’s in!”   [Mouse] “And which way does she want to go?”   [Alice] “I don’t think they meant that! I suppose they meant ‘What does it mean?’”   [Rabbit] “The fan and the three cards began beating time (one, two, one, two) with more mechanically than if they had been drumsticks.   [Alice] “Come, there’s no use in crying like that!"   [Alice] I advise you to leave off this minute!   [Mouse] Cats!   [Alice] “There ought to be a word like ‘coxswain’ to express a person who has been tossed out to sea in a corkscrew if there’s one born to the purpose of any use in speaking of such a thing.
id"gen-1727810556-ayUrHCsGcTe4O94g2Fow" 
total_cost0.00011525
upstream_id"chatcmpl-69fee106-f002-44d3-a6ec-4c3fc9518f71" 
created_at"2024-10-01T19:22:46.455387+00:00" Tuesday, October 1st, 2024 at 7:22:46 PM GMT+00:00
model"eva-unit-01/eva-qwen-2.5-14b" 
app_id182717
streamedtrue
cancelledfalse
provider_name"Infermatic" 
latency526
moderation_latency(null)
generation_time8911
finish_reason"stop" 
tokens_prompt117
tokens_completion171
native_tokens_prompt119
native_tokens_completion171
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.00011525

Evaluation details

Result Evaluator Details Meta Data
Fail Matches Regex
/Alice: ["“”]What a curious feeling! I must be shutting up like a telescope\.["“”]\s+Mouse: ["“”]Not like cats! Would you like cats if you were me\?["“”]\s+Alice: ["“”]Come, there['‘’]s no use in crying like that! I advise you to leave off this minute!["“”]/
 n/a