Model

EVA Qwen 2.5 14B

Test

Voice/dialogue sheets

Scenario

Simple (1-shot)

Run ID

2024-10-01-01J94RHK2B4M3CS5XSF55P79NE

Model input

System
You are an editor for novels. Whenever given text, you will extract the contained dialogue as a voice sheet in the following format: Speaker: "Dialogue"
User/Human
Sarah leaned back in her chair, her eyes sparkling with excitement. "Oh, it was interesting, to say the least. I tried skydiving for the first time." "Wow! That's amazing," Mark exclaimed, his coffee forgotten. "How was it?"
AI
Sarah: "Oh, it was interesting, to say the least. I tried skydiving for the first time." Mark: "Wow! That's amazing. How was it?"
User/Human
“What a curious feeling!” said Alice; “I must be shutting up like a telescope.” “Not like cats!” cried the Mouse, in a shrill, passionate voice. “Would you like cats if you were me?” “Come, there’s no use in crying like that!” said Alice to herself, rather sharply; “I advise you to leave off this minute!”

Model response

AI
“What a curious feeling!” said Alice. “Oh, not like cats!” cried the Mouse, in a shrill, passionate voice. “Would you like cats if you were me?” “Come, there’s no use in crying like that!” said Alice to herself, rather sharply. “I advise you to leave off this minute!”
id"gen-1727810555-gTP33re8Ggafu1IENBZ6" 
total_cost0.000089
upstream_id"chatcmpl-c4979fb4-3b0d-4892-aee3-06ca2543e2d6" 
created_at"2024-10-01T19:22:40.269163+00:00" Tuesday, October 1st, 2024 at 7:22:40 PM GMT+00:00
model"eva-unit-01/eva-qwen-2.5-14b" 
app_id182717
streamedtrue
cancelledfalse
provider_name"Infermatic" 
latency1040
moderation_latency(null)
generation_time3941
finish_reason"stop" 
tokens_prompt216
tokens_completion67
native_tokens_prompt220
native_tokens_completion68
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.000089

Evaluation details

Result Evaluator Details Meta Data
Fail Matches Regex
/Alice: ["“”]What a curious feeling! I must be shutting up like a telescope\.["“”]\s+Mouse: ["“”]Not like cats! Would you like cats if you were me\?["“”]\s+Alice: ["“”]Come, there['‘’]s no use in crying like that! I advise you to leave off this minute!["“”]/
n/a