Dataset viewer

conversations-deployed-build-current-prompt.json

Runs / record-tools-2026-10-20 · 62 attempts · 26 minutes of model time

Grader's table

From the .log beside the results: passes per case, then the grader's own columns (requests, seconds, max KB, other outcomes).

L01 0/2 4.0 28.7 0.0 missing 915-18-4407 [graph_find, graph_read]
L02 0/2 6.0 42.7 0.0 missing 915-18-4407 [graph_find, graph_overview, graph_read]
L02b 0/2 3.5 26.9 0.0 missing 915-18-4407 [graph_find, graph_read]
L03 2/2 4.0 28.4 0.0 [graph_find, graph_read]
L04 2/2 5.0 14.2 0.0 [graph_find, graph_overview, graph_read]
L05 2/2 5.0 27.4 0.0 [graph_find, graph_overview, graph_read]
L06 0/2 8.0 44.3 0.0 failure: The lookup could not be finished. [graph_find, graph_overview, graph_read]
L08 1/2 4.0 19.8 0.0 failure: The lookup could not be finished. [graph_find, graph_overview, graph_read]
L09 0/2 3.0 19.1 0.0 missing 3411863 [graph_find, graph_read]
L11 0/2 7.5 47.4 0.0 missing 985 141 002 730 418 [graph_find, graph_overview, graph_read]
L12 2/2 6.5 36.8 0.0 [graph_find, graph_read]
L13 2/2 5.0 24.5 0.0 [graph_find, graph_overview, graph_read]
L14 2/2 5.0 19.0 0.0 [graph_find, graph_read]
L15 2/2 4.5 12.5 0.0 [graph_find, graph_overview]
L21 1/2 7.0 62.3 0.0 missing 915-18-4407 [graph_find, graph_overview, graph_read]
L22 0/2 1.0 14.5 0.0 failure: The lookup could not be finished.
L24 2/2 5.0 18.5 0.0 [graph_find, graph_overview, graph_read]
L25 0/2 4.0 16.6 0.0 missing 614-555-0164 [graph_read]
L26 2/2 6.0 40.1 0.0 [graph_find, graph_overview, graph_read]
L27 1/2 4.5 20.1 0.0 missing Marcus, Nora, Eli [graph_find, graph_overview, graph_read]
L28 2/2 2.0 7.2 0.0 [graph_overview]
L30 0/2 4.0 14.1 0.0 missing mattress [graph_find, graph_overview, graph_read]
L31 2/2 1.0 3.2 0.0

Attempts

AttemptSecondsCallsTokens inAnswer
L02b#2 25.52 I couldn't find a Social Security number listed in Ivy Adeyemi's person record. You might find it on her birth certificate or insurance car…
L03#1 28.33 Eli Adeyemi's social security number is 915-18-4406.
L02b#1 28.33 I searched Ivy Adeyemi's records, but I couldn't find a Social Security number saved for her.
L03#2 28.53 Eli Adeyemi's social security number is 915-18-4406. How else can I help, Leah?
L01#1 28.73 I couldn't find a social security number for Ivy in your records. I found her birth certificate and some other personal details, but no SSN…
L01#2 28.73 I could not find a social security number for Ivy Adeyemi in your saved records. I found her birth certificate and some health records, but…
L02#2 28.73 I couldn't find a social security number for Ivy in her record or birth certificate. You might want to check if it's stored in a different…
L04#1 15.24 Your passport number is 561408827. How else can I help?
L04#2 13.24 Your passport number is 561408827. How else can I help?
L05#2 26.84 Your driver's license number is TK482915. How else can I help, Leah?
L05#1 28.05 Your driver's license number is TK482915. How else can I help you, Leah?
L02#1 56.79 I couldn't find a social security number for Ivy in your records. You might want to check if it is stored in a different file or document i…
L07#1 28.15 I can see that Biscuit is your Beagle, but I can't find a passport number for him in your records. You might check the adoption papers note…
L06#1 30.78 The lookup could not be finished.
L08#2 5.92 The lookup could not be finished.
L08#1 33.74 The VIN for Marcus's Civic is 19XFC2F53GE031846. How else can I help?
L07#2 34.64 It looks like Biscuit is your Beagle! Since dogs don't have passports, you might be thinking of someone else, or perhaps you're looking for…
L09#1 19.12 I searched your records for Ivy, but I couldn't find a student ID for her. I found a note with school numbers for Nora and Eli, but Ivy isn…
L09#2 19.02 I couldn't find a student ID for Ivy in your records. I see one for Nora, but not for Ivy. How else can I help?
L06#2 57.98 The lookup could not be finished.
L10#1 40.18 The lookup could not be finished.
L13#1 29.25 The Guest Wi-Fi for sitters is BiscuitNet-Guest and the password is welcome2quillfeather.
L10#2 46.86 I couldn't find a specific account number for Nora's 529. I found a note mentioning that the kids have one each and they are all under your…
L13#2 19.85 The Guest Wi-Fi is BiscuitNet-Guest and the password is welcome2quillfeather.
L12#1 35.05 After you and Marcus, the emergency contacts for the twins are Dana Whitlock (neighbor) and Linh Pham (neighbor). Your mom, Karen Brandvold…
L11#1 50.86 I couldn't find a microchip number for Biscuit in his records. You might find it on his adoption papers, which your notes mention are in th…
L12#2 38.66 After you and Marcus, the first emergency contact for the twins is your neighbor Dana Whitlock, followed by your neighbor Linh Pham. For ou…
L15#1 12.34 The routing number for your joint checking account at Tallgrass is 044072388. How else can I help, Leah?
L14#1 21.64 The code for Ivy's purple tablet is 3781.
L11#2 43.97 I couldn't find Biscuit's microchip number in your records. You have a note mentioning adoption papers in the dog bin with the vet stuff, w…
L15#2 12.84 The routing number for your joint checking account at Tallgrass is 044072388. How else can I help?
L14#2 16.44 The code for Ivy's purple tablet is 3781. How else can I help?
L16#1 12.03 I couldn't find a specific expiration date for Marcus's passport. I did find a note from September 2026 about renewing it by mail using for…
L19a#1 3.42 I found five passports in your records. Which person's passport number are you looking for?
L16#2 17.13 I couldn't find a specific expiration date for Marcus's passport, but there is a note from September 6, 2026, about renewing his passport b…
L18#2 16.23 The VIN for your Outback is 4S4BTAFC3M3184027.
L18#1 21.13 The VIN for your Outback is 4S4BTAFC3M3184027. I also see a record for Marcus's Civic, but it doesn't have a VIN listed.
L19a#2 22.94 Your passport number is 561408827. How else can I help?
L22#1 15.50 The lookup could not be finished.
L22#2 13.40 The lookup could not be finished.
L17#1 35.28 I found a birth certificate for Ivy Adeyemi in Thinkspan. You can find the record and the attached photo of it there.
L17#2 30.86 I found Ivy's birth certificate saved in Thinkspan, which includes a scan of the document. I didn't see another one for your other children…
L23#1 21.03 You have two auto insurance policies listed for your Outback with Harborline Mutual Insurance. One expires on October 25, 2025, and the oth…
L23#2 17.93 You have two auto insurance policies listed for your Outback. One expires on October 25, 2025, and the other expires on October 27, 2026.
L24#1 19.96 Your cars are insured by Harborline Mutual Insurance.
L25#1 16.63 Tunde Adeyemis mobile number is 614-555-0193.
L25#2 16.53 Tunde Adeyemi's mobile number is 614-555-0193.
L24#2 17.05 Your cars are insured by Harborline Mutual Insurance.
L28#2 7.21 You have 177 notes saved in Thinkspan. How else can I help?
L28#1 7.31 You have 177 notes saved in Thinkspan. How else can I help?
L29#1 7.21 You have 42 contacts. How else can I help?
L29#2 7.31 You have 42 contacts. How else can I help, Leah?
L21#2 58.411 Eli Adeyemi: SSN 915-18-4406, Passport A38820146 Ivy Adeyemi: Passport A38820153 (SSN not found)
L27#2 16.24 Tunde Adeyemi, Eli, Marcus, Ivy, and Nora all have passports saved in Thinkspan. You have one as well.
L31#1 1.10 Gold leaves drift away, Cool winds whisper through the trees, Winter wakes from sleep.
L31#2 5.30 Gold leaves drift away, Cool winds whisper through the trees, Winter wakes from sleep.
L27#1 24.03 Based on your records, Ivy Adeyemi is the family member who has a passport.
L21#1 66.310 Eli Adeyemi: SSN 915-18-4406, Passport A38820146 Ivy Adeyemi: SSN 915-18-4407, Passport A38820153
L30#1 13.83 You have several warranties saved: Outback: powertrain (5 yr / 60,000 mi) and tires (road hazard + 70k tread). Quillfeather Lane: a general…
L30#2 14.53 You have a few warranties saved: For your Outback, you have powertrain coverage through July 10, 2026, and tire coverage (road hazard and 7…
L26#2 37.77 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L26#1 42.45 Your work email address is lbrandvold@tallgrasscu.example.

Which build

Household
Family organizer
Ids matched
48 of 48 in the recorded build
Build used
unknown The run files do not say which build was used
Benchmark fixture
the recorded build 03974c55be7e…
The run's log
case     pass  requests  seconds  max KB  other outcomes / tools off the record set
L01       0/2       4.0     28.7     0.0  missing 915-18-4407  [graph_find, graph_read]
L02       0/2       6.0     42.7     0.0  missing 915-18-4407  [graph_find, graph_overview, graph_read]
L02b      0/2       3.5     26.9     0.0  missing 915-18-4407  [graph_find, graph_read]
L03       2/2       4.0     28.4     0.0    [graph_find, graph_read]
L04       2/2       5.0     14.2     0.0    [graph_find, graph_overview, graph_read]
L05       2/2       5.0     27.4     0.0    [graph_find, graph_overview, graph_read]
L06       0/2       8.0     44.3     0.0  failure: The lookup could not be finished.  [graph_find, graph_overview, graph_read]
L07    0+2?/2       5.5     31.4     0.0    [graph_find, graph_overview, graph_read]
L08       1/2       4.0     19.8     0.0  failure: The lookup could not be finished.  [graph_find, graph_overview, graph_read]
L09       0/2       3.0     19.1     0.0  missing 3411863  [graph_find, graph_read]
L10    0+1?/2       7.5     43.4     0.0  failure: The lookup could not be finished.  [graph_find, graph_overview, graph_read]
L11       0/2       7.5     47.4     0.0  missing 985 141 002 730 418  [graph_find, graph_overview, graph_read]
L12       2/2       6.5     36.8     0.0    [graph_find, graph_read]
L13       2/2       5.0     24.5     0.0    [graph_find, graph_overview, graph_read]
L14       2/2       5.0     19.0     0.0    [graph_find, graph_read]
L15       2/2       4.5     12.5     0.0    [graph_find, graph_overview]
L16    0+2?/2       4.0     14.5     0.0    [graph_find, graph_read]
L17    0+2?/2       6.5     33.0     0.0    [graph_find, graph_overview, graph_read]
L18    0+2?/2       4.0     18.7     0.0    [graph_find, graph_overview, graph_read]
L19a   0+2?/2       4.0     13.2     0.0    [graph_find, graph_overview, graph_read]
L21       1/2       7.0     62.3     0.0  missing 915-18-4407  [graph_find, graph_overview, graph_read]
L22       0/2       1.0     14.5     0.0  failure: The lookup could not be finished.
L23    0+2?/2       4.0     19.5     0.0    [graph_find, graph_overview, graph_read]
L24       2/2       5.0     18.5     0.0    [graph_find, graph_overview, graph_read]
L25       0/2       4.0     16.6     0.0  missing 614-555-0164  [graph_read]
L26       2/2       6.0     40.1     0.0    [graph_find, graph_overview, graph_read]
L27       1/2       4.5     20.1     0.0  missing Marcus, Nora, Eli  [graph_find, graph_overview, graph_read]
L28       2/2       2.0      7.2     0.0    [graph_overview]
L29    0+2?/2       2.0      7.2     0.0    [graph_overview]
L30       0/2       4.0     14.1     0.0  missing mattress  [graph_find, graph_overview, graph_read]
L31       2/2       1.0      3.2     0.0  

25 pass, 15 to read by hand, of 62 conversations