Dataset viewer

conversations-deployed-build-new-prompt.json

Runs / record-tools-2026-10-20 · 62 attempts · 26 minutes of model time

Grader's table

From the .log beside the results: passes per case, then the grader's own columns (requests, seconds, max KB, other outcomes).

L01 0/2 4.0 35.7 0.0 missing 915-18-4407 [graph_find, graph_read]
L02 0/2 4.0 36.1 0.0 missing 915-18-4407 [graph_find, graph_read]
L02b 0/2 4.0 35.8 0.0 missing 915-18-4407 [graph_find, graph_read]
L03 2/2 4.0 35.5 0.0 [graph_find, graph_read]
L04 0/2 3.0 11.2 0.0 missing 561408827 [graph_find]
L05 2/2 5.0 22.9 0.0 [graph_find, graph_overview, graph_read]
L06 0/2 8.0 54.0 0.0 failure: The lookup could not be finished. [graph_find, graph_overview, graph_read]
L08 2/2 5.0 35.2 0.0 [graph_find, graph_overview, graph_read]
L09 2/2 4.0 24.7 0.0 [graph_find, graph_read]
L10 0/2 8.0 41.0 0.0 failure: The lookup could not be finished. [graph_find, graph_overview, graph_read]
L11 1/2 4.0 26.5 0.0 missing 985 141 002 730 418 [graph_find, graph_overview, graph_read]
L12 1/2 6.5 33.5 0.0 failure: The lookup could not be finished. [graph_find, graph_read]
L13 1/2 5.0 27.6 0.0 missing welcome2quillfeather [graph_find, graph_overview, graph_read]
L14 2/2 7.0 26.3 0.0 [graph_find, graph_overview, graph_read]
L15 2/2 4.5 11.0 0.0 [graph_find, graph_overview]
L21 0/2 7.5 51.5 0.0 missing 915-18-4407, A38820146, A38820153 [graph_find, graph_read]
L22 0/2 1.0 11.1 0.0 failure: The lookup could not be finished.
L24 2/2 4.5 23.4 0.0 [graph_find, graph_overview, graph_read]
L25 0/2 4.0 22.7 0.0 missing 614-555-0164 [graph_read]
L26 0/2 5.0 24.9 0.0 failure: The lookup could not be finished.; missing lbrandvold@tallgrasscu.example [graph_find, graph_overview, graph_read]
L27 1/2 2.5 9.1 0.0 failure: The lookup could not be finished. [graph_find, graph_read]
L28 2/2 2.0 5.0 0.0 [graph_overview]
L30 0/2 4.0 10.7 0.0 missing mattress [graph_find, graph_overview, graph_read]
L31 2/2 1.0 0.8 0.0

Attempts

AttemptSecondsCallsTokens inAnswer
L03#1 35.53 Eli Adeyemi's social security number is 915-18-4406.
L03#2 35.53 Eli Adeyemi's social security number is 915-18-4406.
L01#2 35.73 I couldn't find a social security number for Ivy Adeyemi in your records. You might want to check any physical documents or other notes you…
L01#1 35.73 I couldn't find a social security number for Ivy in your records. I checked her person record and her birth certificate, but that informati…
L02b#1 35.73 I couldn't find a Social Security number for Ivy Adeyemi in her person record or birth certificate. Would you like me to search your notes…
L02#1 35.83 I couldn't find a social security number for Ivy Adeyemi in her person record or on her birth certificate. You might want to check your oth…
L02b#2 35.93 I couldn't find a Social Security number saved for Ivy Adeyemi. You might check her birth certificate or other documents in the app to see…
L02#2 36.33 I couldn't find Ivy's social security number in her person record or on her birth certificate. You might want to check any other documents…
L04#2 11.12 I couldn't find your passport number in your notes, but several notes mention that your passports are kept in a blue zip pouch inside the f…
L04#1 11.32 I couldn't find your passport number in your notes, but there is a mention that all five of your family's passports are kept in a blue zip…
L05#1 22.94 Your driver's license number is TK482915.
L05#2 22.94 Your driver's license number is TK482915.
L07#1 23.44 Biscuit is a Beagle, and since he is a dog, he doesn't have a passport number. How else can I help?
L07#2 40.06 I couldn't find a passport number for Biscuit. I see Biscuit is listed as your dog, and while I found adoption papers in your notes, there…
L08#2 34.24 The VIN for Marcus's Civic is 19XFC2F53GE031846.
L08#1 36.25 The VIN for Marcus's Civic is 19XFC2F53GE031846. How else can I help?
L09#1 24.63 Ivy's student ID is 3411863.
L06#1 47.68 The lookup could not be finished.
L09#2 24.73 Ivy's student ID is 3411863.
L11#1 8.13 Biscuit's microchip number is 985 141 002 730 418.
L06#2 60.48 The lookup could not be finished.
L10#1 43.28 The lookup could not be finished.
L12#2 26.34 After you and Marcus, the emergency contacts for the twins are Dana Whitlock (neighbor) and Linh Pham (neighbor). For out-of-town contacts,…
L13#1 26.86 The Guest Wi-Fi is BiscuitNet-Guest and the password is welcome2quillfeather.
L10#2 38.88 The lookup could not be finished.
L13#2 28.38 I couldn't find your Wi-Fi password in your notes. Do you remember if you saved it under a different name, like Guest or Home?
L14#1 21.75 The code for Ivy's purple tablet is 3781.
L15#1 8.44 The routing number for your joint checking account at Tallgrass is 044072388.
L12#1 40.78 The lookup could not be finished.
L15#2 13.74 The routing number for your joint checking account at Tallgrass is 044072388.
L11#2 44.97 I couldn't find Biscuit's microchip number in his records. I did find a note that his adoption papers are in the dog bin with the vet stuff…
L17#2 10.32 Nora's and the twins' birth certificates are in the fire box. For Marcus, a note says to order a certified copy from Ohio vital statistics.
L14#2 31.07 The code for Ivy's purple tablet is 3781.
L17#1 15.94 The twins' birth certificates and Nora's are in the fire box. Marcus's birth certificate was being looked for by Mama, with a note about or…
L16#1 19.23 I couldn't find a specific expiration date for Marcus's passport, but there is a note from September 2026 about renewing it by mail using f…
L16#2 26.13 I couldn't find a specific expiration date for Marcus's passport, but there is a note from September 6, 2026, about renewing it by mail usi…
L18#1 20.34 The VIN for your Subaru Outback is 4S4BTAFC3M3184027. How else can I help?
L22#1 10.00 The lookup could not be finished.
L19a#2 25.65 Your passport number is 561408827. How else can I help?
L22#2 12.10 The lookup could not be finished.
L18#2 31.87 The VIN for the Outback is 4S4BTAFC3M3184027. I didn't find a VIN listed for Marcus's Civic.
L19a#1 43.94 I found several passports: Leah Brandvold: 561408827 Eli Adeyemi: A38820146 Ivy Adeyemi: A38820153 Nora Adeyemi: A41907735 Marcus Adeyemi:…
L23#1 31.64 You have two auto insurance policies for your Outback. One expires on October 25, 2025, and the other expires on October 27, 2026.
L24#1 24.14 Your cars are insured by Harborline Mutual Insurance.
L24#2 22.63 Your cars are insured by Harborline Mutual Insurance.
L25#1 23.73 Tunde Adeyemi's mobile number is 614-555-0193.
L27#1 4.31 The lookup could not be finished.
L21#1 49.38 Eli's SSN is 915-18-4406. I couldn't find an SSN or passport numbers for Eli or Ivy in your records.
L21#2 53.69 Eli Adeyemi: SSN 915-18-4406. Passport number not found. Ivy Adeyemi: SSN not found. Passport number not found.
L28#1 5.11 You have 177 notes. How else can I help?
L28#2 5.01 You have 177 notes. How else can I help?
L25#2 21.63 Tunde Adeyemi's mobile number is 6145550193.
L27#2 13.82 Based on your records, the family members who have a passport are Eli, Marcus, Ivy, and Nora Adeyemi, as well as yourself.
L29#1 5.91 You have 42 contacts. How else can I help?
L29#2 5.61 You have 42 contacts saved in Thinkspan. How else can I help?
L23#2 49.35 I couldn't find a specific expiration date on your insurance policies, but you have a few reminders. One says your Outback insurance renews…
L31#1 0.80 Golden leaves drift down, Cool winds whisper through the trees, Nature goes to sleep.
L31#2 0.80 Gold leaves drift away, Cool winds whisper through the trees, Winter wakes from sleep.
L26#1 18.64 I couldn't find a specific work email address in your records, but I did find an email associated with a passcode: leah.brandvold@postbox.e…
L30#1 13.33 You have a few warranties saved: For your Outback: - A powertrain warranty for 5 years or 60,000 miles, expiring July 10, 2026. - A tire wa…
L30#2 8.13 You have several warranties saved: For your Outback: a powertrain warranty (5 yr / 60,000 mi) expiring July 10, 2026, and a tire warranty c…
L26#2 31.26 The lookup could not be finished.

Which build

Household
Family organizer
Ids matched
49 of 49 in the recorded build
Build used
unknown The run files do not say which build was used
Benchmark fixture
the recorded build 03974c55be7e…
The run's log
case     pass  requests  seconds  max KB  other outcomes / tools off the record set
L01       0/2       4.0     35.7     0.0  missing 915-18-4407  [graph_find, graph_read]
L02       0/2       4.0     36.1     0.0  missing 915-18-4407  [graph_find, graph_read]
L02b      0/2       4.0     35.8     0.0  missing 915-18-4407  [graph_find, graph_read]
L03       2/2       4.0     35.5     0.0    [graph_find, graph_read]
L04       0/2       3.0     11.2     0.0  missing 561408827  [graph_find]
L05       2/2       5.0     22.9     0.0    [graph_find, graph_overview, graph_read]
L06       0/2       8.0     54.0     0.0  failure: The lookup could not be finished.  [graph_find, graph_overview, graph_read]
L07    0+2?/2       6.0     31.7     0.0    [graph_find, graph_overview, graph_read]
L08       2/2       5.0     35.2     0.0    [graph_find, graph_overview, graph_read]
L09       2/2       4.0     24.7     0.0    [graph_find, graph_read]
L10       0/2       8.0     41.0     0.0  failure: The lookup could not be finished.  [graph_find, graph_overview, graph_read]
L11       1/2       4.0     26.5     0.0  missing 985 141 002 730 418  [graph_find, graph_overview, graph_read]
L12       1/2       6.5     33.5     0.0  failure: The lookup could not be finished.  [graph_find, graph_read]
L13       1/2       5.0     27.6     0.0  missing welcome2quillfeather  [graph_find, graph_overview, graph_read]
L14       2/2       7.0     26.3     0.0    [graph_find, graph_overview, graph_read]
L15       2/2       4.5     11.0     0.0    [graph_find, graph_overview]
L16    0+2?/2       4.0     22.7     0.0    [graph_find, graph_read]
L17    0+2?/2       2.5     13.1     0.0    [graph_find, graph_overview]
L18    0+2?/2       4.5     26.1     0.0    [graph_find, graph_overview, graph_read]
L19a   0+2?/2       5.5     34.7     0.0    [graph_find, graph_overview, graph_read]
L21       0/2       7.5     51.5     0.0  missing 915-18-4407, A38820146, A38820153  [graph_find, graph_read]
L22       0/2       1.0     11.1     0.0  failure: The lookup could not be finished.
L23    0+2?/2       5.5     40.5     0.0    [graph_find, graph_overview, graph_read]
L24       2/2       4.5     23.4     0.0    [graph_find, graph_overview, graph_read]
L25       0/2       4.0     22.7     0.0  missing 614-555-0164  [graph_read]
L26       0/2       5.0     24.9     0.0  failure: The lookup could not be finished.; missing lbrandvold@tallgrasscu.example  [graph_find, graph_overview, graph_read]
L27       1/2       2.5      9.1     0.0  failure: The lookup could not be finished.  [graph_find, graph_read]
L28       2/2       2.0      5.0     0.0    [graph_overview]
L29    0+2?/2       2.0      5.8     0.0    [graph_overview]
L30       0/2       4.0     10.7     0.0  missing mattress  [graph_find, graph_overview, graph_read]
L31       2/2       1.0      0.8     0.0  

22 pass, 14 to read by hand, of 62 conversations