Model

Lumimaid v0.2 8B

Test

Voice/dialogue sheets

Scenario

Unattributed dialogue

Run ID

2024-09-20-01J881PGAX84MA2SK6G368C6MS

Model input

System
You are an editor for novels. Whenever given text, you will extract the contained dialogue as a voice sheet in the following format: Speaker: "Dialogue"
User/Human
"Hey Sarah, how was your weekend?" "Oh, hi Elena! It was interesting, to say the least. I tried skydiving for the first time." "Wow! That's amazing. How was it?" "Terrifying at first, but then absolutely exhilarating. The free fall was like nothing I've ever experienced." "I can't even imagine. What made you decide to try it?" "It was on my bucket list, and I figured why not now? Life's too short to keep putting things off." "That's really inspiring. Maybe I should take a page out of your book and try something new too." "You absolutely should! What's something you've always wanted to do?" "Hmm... I've always wanted to learn to play the guitar." "Well, there's no time like the present. Why don't you sign up for lessons this week?" "You know what? I think I will. Thanks for the push, Sarah!" "Anytime! Can't wait to hear you shred some tunes soon."

Model response

AI
Elena: "Hello? Is anybody there?" Sarah: "Hey! I'm standing right outside." Elena: "Oh, I was worried for a second there. Come in, I'm so glad you made it!" Sarah: "You know, it's really beautiful here. The woods are lovely." Elena: "I'm so glad you like it. Let me show you around." Sarah: "Oh, looks like a bridge. What kind of bridge is that?" Elena: "It's a wrought iron girder bridge. It was built back in the 1800s." Sarah: "Wow, that's fascinating! I love the design." Elena: "I know, right? And check out these old cars nearby. They're from the asylum." Sarah: "Oh my gosh, are you telling me these used to be patients' vehicles?" Elena: "Yeah! It brings back a lot of interesting history, this place." Sarah: "No way, that's cool. And is this another building from the asylum?" Elena: "Yes, we call it the sanctuary house. Reportedly, it used to be used as an emergency treatment building." Sarah: "Oh my gosh, I would not want to be a patient here." Elena: "I know right? It's rumored to be haunted by the former patients." Sarah: "HEROOooh! That sounds so scary!" Elena: "I know! I wanted to show it to you because I thought you'd love the history." Sarah: "Oh, Elena, this is so cool. I'm glad we came."
id"gen-X3zUPWhRgaFr3JWc3MZpQxR4BwoJ" 
total_cost0.0004225
upstream_id"5fdbf90fF0r8TDu2" 
created_at"2024-09-20T15:44:41.30043+00:00" Friday, September 20th, 2024 at 3:44:41 PM GMT+00:00
model"neversleep/llama-3.1-lumimaid-8b" 
app_id182717
streamedtrue
cancelledfalse
provider_name"Mancer" 
latency312
moderation_latency(null)
generation_time5832
finish_reason"stop" 
tokens_prompt298
tokens_completion334
native_tokens_prompt253
native_tokens_completion335
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.0004225

Evaluation details

Result Evaluator Details Meta Data
Fail Matches Regex
/Elena: ["“”]Hey Sarah, how was your weekend\?["“”]\s+Sarah: ["“”]Oh, hi Elena! It was interesting, to say the least\. I tried skydiving for the first time\.["“”]\s+Elena: ["“”]Wow! That['‘’]s amazing\. How was it\?["“”]\s+Sarah: ["“”]Terrifying at first, but then absolutely exhilarating\. The free fall was like nothing I['‘’]ve ever experienced\.["“”]\s+Elena: ["“”]I can['‘’]t even imagine\. What made you decide to try it\?["“”]\s+Sarah: ["“”]It was on my bucket list, and I figured why not now\? Life['‘’]s too short to keep putting things off\.["“”]\s+Elena: ["“”]That['‘’]s really inspiring\. Maybe I should take a page out of your book and try something new too\.["“”]\s+Sarah: ["“”]You absolutely should! What['‘’]s something you['‘’]ve always wanted to do\?["“”]\s+Elena: ["“”]Hmm\.\.\. I['‘’]ve always wanted to learn to play the guitar\.["“”]\s+Sarah: ["“”]Well, there['‘’]s no time like the present\. Why don['‘’]t you sign up for lessons this week\?["“”]\s+Elena: ["“”]You know what\? I think I will\. Thanks for the push, Sarah!["“”]\s+Sarah: ["“”]Anytime! Can['‘’]t wait to hear you shred some tunes soon\.["“”]/
 n/a