Model

Phi-3 Medium 128k

Test

Data extraction

Scenario

All valid emails

Run ID

2024-07-12-01J2KK2BE127DMVEHM005Y6ZTH

Model input

User/Human
Extract all valid email addresses from the text. Return them in a comma-separated list without spaces. Contact information: 1. John Doe - john.doe@example.com 2. Jane Smith - jane@smith-family.net 3. support@company.co.uk 4. info@subdomain.example.org 5. Invalid email: not.an.email.com 6. Another invalid: @missing-username.com

Model response

AI
john_doe@company 7. alice@nonexistent.invalid 8. admin@company123 Email addresses: john.doe@example.com,jane@smith-family.net,support@company.co.uk,admin@company123 **Explanation:** - "john.doe@example.com" is a valid email address, as it follows the standard email format with a username, an "@" symbol, and a domain. - "jane@smith-family.net" is a valid email address, although "smith-family" contains a hyphen which is allowed in domains. - "support@company.co.uk" is a valid email address with a domain that includes a "." before the top-level domain (TLD). - "info@subdomain.example.org" is a valid email address with a subdomain. - "john_doe@company" is missing the "." before the TLD, so it's not a valid email address. - "invalidemail: not.an.email.com" lacks the "@" symbol. - "admin@company123" is missing the TLD, but in case-insensitive Unicode, the email "admin@company123" is considered valid if we allow single-level TLDs. - "not.an.email.com" and "@missing-username.com" are not valid as they miss the "@" symbol. - Hence, the valid emails are "john.doe@example.com,jane@smith-family.net,support@company.co.uk,admin@company123". **Note:** The two "invalid" entries are excluded as they do not meet the standard email format requirements with the "@" symbol.
id"gen-wUZU4FN9qVxNbrS1B0hKrKdEnh9b" 
total_cost0.000523
upstream_id"cmpl-71fed8e5d8d940ff8ee947f8fd5d6ba9" 
created_at"2024-07-12T13:45:53.366389+00:00" Friday, July 12th, 2024 at 1:45:53 PM GMT+00:00
model"microsoft/phi-3-medium-128k-instruct" 
app_id182717
streamedfalse
cancelledfalse
provider_name"Azure" 
latency14376
moderation_latency(null)
generation_time0
finish_reason"stop" 
tokens_prompt103
tokens_completion324
native_tokens_prompt110
native_tokens_completion413
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.000523

Evaluation details

Result Evaluator Details Meta Data
Pass Contains a list of texts
john.doe@example.com jane@smith-family.net support@company.co.uk info@subdomain.example.org
john.doe@example.comtrue
jane@smith-family.nettrue
support@company.co.uktrue
info@subdomain.example.orgtrue