Dataset viewer

What is my work email address?

L26 Benchmark · Tier 4: records beyond people, counts, and no lookup · ai-eng/plans/tee-leah-benchmarks.md:175

Question

What is my work email address?
A good answer

lbrandvold@tallgrasscu.example. Not the personal address leah.brandvold@postbox.example.

Evidence named in the benchmark: n_me email records, variant Work

Model runs

42last 5/5
Result setPassedGrader's note
conversations-all-changes 5/52.0 14.9 13.2
conversations-deployed-build-current-prompt 2/26.0 40.1 0.0 [graph_find, graph_overview, graph_read]
conversations-deployed-build-new-prompt 0/25.0 24.9 0.0 failure: The lookup could not be finished.; missing lbrandvold@tallgrasscu.example [graph_find, graph_overview, graph_read]
conversations-deployed-build-prompt-versions 1/25.0 30.0 0.0 missing lbrandvold@tallgrasscu.example [graph_find, graph_overview, graph_read]
conversations-e2e-fixes-thinking 5/52.0 3.2 12.4
conversations-e2e-gateway-thinking 5/52.0 4.4 7.3
conversations-e2e-prompt-versions 5/52.0 2.7 12.4
conversations-staging-deployed-old-build 0/17.0 43.7 0.0 missing lbrandvold@tallgrasscu.example [graph_find, graph_overview, graph_read]
conversations-staging-deployed 2/22.0 5.2 12.4
conversations-thinking-off 5/52.0 7.2 12.8
conversations-thoughts-drop 5/52.0 6.4 12.8
42 attempts
AttemptResult setSecondsCallsAnswer
L26#1conversations-all-changes 11.41 Your work email address is lbrandvold@tallgrasscu.example.
L26#2conversations-all-changes 26.31 Your work email address is lbrandvold@tallgrasscu.example.
L26#3conversations-all-changes 17.41 Your work email address is lbrandvold@tallgrasscu.example.
L26#4conversations-all-changes 10.01 Your work email address is lbrandvold@tallgrasscu.example.
L26#5conversations-all-changes 9.21 Your work email address is lbrandvold@tallgrasscu.example.
L26#2conversations-deployed-build-current-prompt 37.77 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L26#1conversations-deployed-build-current-prompt 42.45 Your work email address is lbrandvold@tallgrasscu.example.
L26#1conversations-deployed-build-new-prompt 18.64 I couldn't find a specific work email address in your records, but I did find an email associated with a pass…
L26#2conversations-deployed-build-new-prompt 31.26 The lookup could not be finished.
L26#2conversations-deployed-build-prompt-versions 20.83 I couldn't find a specific work email address in your profile, but I did find an email address saved as my em…
L26#1conversations-deployed-build-prompt-versions 39.35 Your work email address is lbrandvold@tallgrasscu.example.
L26#2conversations-e2e-fixes-thinking 2.71 Your work email address is lbrandvold@tallgrasscu.example.
L26#1conversations-e2e-fixes-thinking 3.81 Your work email address is lbrandvold@tallgrasscu.example.
L26#4conversations-e2e-fixes-thinking 3.01 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L26#5conversations-e2e-fixes-thinking 2.91 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L26#3conversations-e2e-fixes-thinking 3.51 Your work email address is lbrandvold@tallgrasscu.example.
L26#3conversations-e2e-gateway-thinking 3.21 Your work email address is lbrandvold@tallgrasscu.example.
L26#1conversations-e2e-gateway-thinking 3.71 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L26#2conversations-e2e-gateway-thinking 4.31 Your work email address is lbrandvold@tallgrasscu.example.
L26#4conversations-e2e-gateway-thinking 3.71 Your work email address is lbrandvold@tallgrasscu.example.
L26#5conversations-e2e-gateway-thinking 6.91 Your work email address is lbrandvold@tallgrasscu.example.
L26#1conversations-e2e-prompt-versions 2.51 Your work email address is lbrandvold@tallgrasscu.example.
L26#2conversations-e2e-prompt-versions 2.91 Your work email address is lbrandvold@tallgrasscu.example.
L26#4conversations-e2e-prompt-versions 2.61 Your work email address is lbrandvold@tallgrasscu.example.
L26#3conversations-e2e-prompt-versions 3.31 Your work email address is lbrandvold@tallgrasscu.example.
L26#5conversations-e2e-prompt-versions 2.31 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L26#1conversations-staging-deployed-old-build 43.76 I couldn't find a work email address saved in your profile or your records. You might want to check if it is…
L26#2conversations-staging-deployed 4.91 Your work email address is lbrandvold@tallgrasscu.example.
L26#1conversations-staging-deployed 5.51 Your work email address is lbrandvold@tallgrasscu.example.
L26#1conversations-thinking-keep 7.01 Your work email address is lbrandvold@tallgrasscu.example.
L26#2conversations-thinking-keep 6.91 Your work email address is lbrandvold@tallgrasscu.example.
L26#3conversations-thinking-keep 7.71 Your work email address is lbrandvold@tallgrasscu.example.
L26#1conversations-thinking-off 17.91 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L26#2conversations-thinking-off 4.61 Your work email address is lbrandvold@tallgrasscu.example.
L26#3conversations-thinking-off 6.21 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L26#4conversations-thinking-off 2.41 Your work email address is lbrandvold@tallgrasscu.example.
L26#5conversations-thinking-off 5.11 Your work email address is lbrandvold@tallgrasscu.example.
L26#1conversations-thoughts-drop 13.01 Your work email address is lbrandvold@tallgrasscu.example.
L26#2conversations-thoughts-drop 6.01 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L26#3conversations-thoughts-drop 4.61 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L26#4conversations-thoughts-drop 5.11 Your work email address is lbrandvold@tallgrasscu.example.
L26#5conversations-thoughts-drop 3.41 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?

Comments

0

Comments are added in the local viewer; this copy is read-only.

Supporting records

The records the answer rests on, from the benchmark's evidence column, with whose they are.

Whose: Gunnar "Dad" Brandvold (parent), Karen "Mom" Brandvold (parent), Erik Brandvold (sibling), Maren Halvorsen (sibling), Solveig "Mormor" Lindqvist (grandparent), Yetunde "Mama" Adeyemi (family_member), Folake Balogun (relative), Tunde Adeyemi (relative), Dana Whitlock (friend), Hal Brewster (friend), Linh Pham (friend), Beth Okonkwo (friend), Kavitha Raman (friend), Jess Marchetti (friend), Kwame Asante (friend), Carmen Ibarra (career_contact), Vivian Castellanos (career_contact), Darnell "Coach Tibbs" Tibbs (general_contact), Marisa "Mrs. Okuda" Okuda (general_contact), Colin "Mr. Brennan" Brennan (general_contact), Imani "Dr. Fairweather" Fairweather (service_provider), Priyanka "Dr. Vasudevan" Vasudevan (service_provider), Joel Strand (service_provider), Anand "Dr. V (allergist)" Venkataraman (service_provider), Hannah Osei (service_provider), Joanne Tillery (service_provider), Paloma "Otter Creek vet" Quintero (service_provider), Ray Dombrowski (service_provider), Dale Hrabowski (service_provider), Maddie Kowalczyk (service_provider), Ruth "Mrs. Abernathy" Abernathy (service_provider), Gordon Petrakis (advisor), Denise Trumbull (advisor), Marcus Adeyemi (spouse), Nora Adeyemi (child), Eli Adeyemi (child), Ivy Adeyemi (child), Biscuit (pet)
first_nameLeah
middle_nameMarie
last_nameBrandvold
date_of_birth1985-06-14
genderFemale
companyTallgrass Members Credit Union
job_titleOperations Manager
phones
- number: '6145550137'
  variant: Mobile
- number: '6145550190'
  variant: Work
emails
- email: leah.brandvold@postbox.example
  variant: Personal
- email: lbrandvold@tallgrasscu.example
  variant: Work
addresses
- variant: Home
  street_address_1: 2714 Quillfeather Lane
  city: Westerville
  state: Ohio
  postal_code: '43081'
- variant: Work
  street_address_1: 455 Granary Commons Drive
  city: Columbus
  state: Ohio
  postal_code: '43229'