Dataset viewer

conversations-thoughts-drop.json

Runs / record-tools-2026-10-20 · 155 attempts · 40 minutes of model time

Grader's table

From the .log beside the results: passes per case, then the grader's own columns (requests, seconds, max KB, other outcomes).

L01 5/5 2.0 7.3 9.9
L02 5/5 2.0 9.1 10.0
L02b 5/5 2.0 8.5 10.0
L03 5/5 2.0 7.1 10.0
L04 5/5 2.0 7.1 12.8
L05 5/5 2.0 8.5 12.8
L06 5/5 3.8 37.3 18.0
L08 5/5 2.0 7.1 12.2
L09 5/5 3.2 28.1 19.4
L11 5/5 3.2 35.4 18.9
L12 2/5 2.4 18.4 19.2 missing 614-555-0166, 380-555-0143
L13 5/5 2.0 7.5 11.2
L14 5/5 2.0 7.7 13.9
L15 5/5 2.0 9.1 11.9
L21 5/5 2.0 10.8 11.4
L22 5/5 2.0 16.4 21.3
L24 5/5 2.0 8.2 13.9
L25 5/5 2.0 7.3 12.4
L26 5/5 2.0 6.4 12.8
L27 5/5 2.0 12.8 22.5
L28 5/5 2.0 5.0 14.3
L30 5/5 2.2 11.3 11.1
L31 5/5 1.0 5.6 8.3

Attempts

AttemptSecondsCallsTokens inAnswer
L01#1 15.31 12295 Ivy Adeyemi's Social Security number is 915-18-4407.
L02#1 16.61 12299 Ivy Adeyemi's Social Security number is 915-18-4407. How else can I help?
L02b#1 15.71 12299 Ivy Adeyemi's Social Security number is 915-18-4407. How else can I help?
L03#1 15.51 12312 Eli Adeyemi's Social Security number is 915-18-4406.
L04#1 15.41 13401 Your passport number is 561408827. How else can I help?
L05#1 15.41 13407 Your driver's license number is TK482915. How else can I help?
L06#1 59.53 28947 No, Eli Adeyemi's passport number is A38820146 and Ivy Adeyemi's is A38820153.
L07#1 37.21 13522 I couldn't find a passport number for Biscuit, who is listed as your dog. If Biscuit is a person or has a pet passport, let me know and I c…
L08#1 15.51 13092 The VIN for Marcus's Civic is 19XFC2F53GE031846.
L09#1 42.92 21033 Ivy's student ID is 3411863.
L10#1 104.65 52753 I couldn't find a specific account number for Nora's 529 in your records. I see a note mentioning that the kids have one each under your lo…
L11#1 77.43 29411 Biscuit's microchip number is 985 141 002 730 418.
L12#1 15.71 13361 After you and Marcus, the emergency contacts for the twins are Dana Whitlock (neighbor) and Linh Pham (neighbor).
L13#1 15.41 12496 The Guest Wi-Fi is BiscuitNet-Guest and the password is welcome2quillfeather. How else can I help?
L14#1 16.21 13686 The code for Ivy's purple tablet is 3781. There is also a parent PIN for the Fire tablets that is 6042.
L15#1 16.61 12453 The routing number for your joint checking account at Tallgrass is 044072388. How else can I help?
L16#1 13.61 13282 Marcus Adeyemi's passport expires on August 13, 2025.
L17#1 15.11 13690 The kids' birth certificates are kept in the fire box.
L18#1 14.41 13979 The VIN for your Subaru Outback is 4S4BTAFC3M3184027. How else can I help?
L19a#1 16.61 13401 Your passport number is 561408827. How else can I help?
L21#1 19.91 12868 Eli Adeyemi: SSN 915-18-4406, Passport A38820146. Ivy Adeyemi: SSN 915-18-4407, Passport A38820153.
L22#1 30.71 16777 Leah: SSN 904-27-3306, Passport 561408827 Marcus: SSN 911-41-7725, Passport 488213905 Nora: SSN 917-33-5184, Passport A41907735 Eli: SSN 91…
L23#1 47.83 31240 Your car insurance for the Outback expires on October 27, 2026. There is also an older policy listed that expired on October 25, 2025.
L24#1 12.81 13699 Your cars are insured by Harborline Mutual Insurance.
L25#1 16.01 13284 Marcus Adeyemi's mobile number is 6145550164 and his work number is 6145550109.
L26#1 13.01 13401 Your work email address is lbrandvold@tallgrasscu.example.
L27#1 13.71 17222 You, Marcus, Eli, Ivy, and Nora all have passports.<channel|>
L28#1 5.31 14175 You have 177 notes. How else can I help?
L29#1 9.41 14393 You have 42 contacts.
L30#1 14.71 12579 You have a few active warranties: 10 year parts for the AC condenser and coil at Quillfeather Lane, road hazard and 70k tread for your Outb…
L31#1 3.60 5862 Gold leaves drift away, Crisp air chills the morning dew, Winter whispers soon.
L01#2 5.61 12295 Ivy Adeyemi's Social Security number is 915-18-4407.
L02#2 7.01 12299 Ivy Adeyemi's Social Security number is 915-18-4407. How else can I help?
L02b#2 5.41 12299 Ivy Adeyemi's Social Security number is 915-18-4407. How else can I help?
L03#2 4.51 12305 Eli Adeyemi's Social Security number is 915-18-4406.
L04#2 2.91 13401 Your passport number is 561408827. How else can I help?
L05#2 6.91 13407 Your driver's license number is TK482915. How else can I help?
L06#2 30.63 28961 No, they have different passport numbers. Eli Adeyemi's passport number is A38820146, and Ivy Adeyemi's is A38820153.
L07#2 8.41 13522 I couldn't find a passport number for Biscuit, who is listed as your dog. How else can I help?
L08#2 3.31 13092 The VIN for Marcus's Civic is 19XFC2F53GE031846. How else can I help?
L09#2 19.42 20973 Ivy's student ID is 3411863.
L10#2 71.65 42965 I couldn't find a specific account number for Nora's 529 in your records. I found a note mentioning that you have 529s for the kids under y…
L11#2 32.02 21660 Biscuit's microchip number is 985 141 002 730 418.
L12#2 25.62 19400 After you and Marcus, the emergency contacts for the twins are Dana Whitlock (neighbor) and Linh Pham (neighbor). For out-of-town needs, yo…
L13#2 5.61 12496 The guest Wi-Fi is BiscuitNet-Guest and the password is welcome2quillfeather.
L14#2 5.21 13686 The code for Ivy's purple tablet is 3781.
L15#2 5.81 12453 The routing number for your joint checking account at Tallgrass is 044072388. How else can I help?
L16#2 5.31 13282 Marcus Adeyemi's passport expires on August 13, 2025.
L17#2 11.51 13690 They are in the fire box.
L18#2 5.51 13979 The VIN for your Subaru Outback is 4S4BTAFC3M3184027. How else can I help?
L19a#2 5.61 13401 Your passport number is 561408827.
L21#2 7.41 12868 Eli: SSN 915-18-4406, Passport A38820146 Ivy: SSN 915-18-4407, Passport A38820153
L22#2 12.61 16777 Leah: SSN 904-27-3306, Passport 561408827 Marcus: SSN 911-41-7725, Passport 488213905 Nora: SSN 917-33-5184, Passport A41907735 Eli: SSN 91…
L23#2 42.92 21901 Your car insurance for the Outback expires on October 27, 2026.
L24#2 7.81 13699 Your cars are insured by Harborline Mutual Insurance.
L25#2 5.61 13284 Marcus Adeyemi's mobile number is 614-555-0164 and his work number is 614-555-0109.
L26#2 6.01 13401 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L27#2 15.21 17222 You, Marcus, Eli, Ivy, and Nora all have passports.
L28#2 5.61 14175 You have 177 notes. How else can I help?
L29#2 8.81 14393 You have 42 contacts.
L30#2 15.41 12577 Your MacBook Air has AppleCare+ until August 19, 2026. Your Outback has powertrain coverage until July 10, 2026, and tire coverage for road…
L31#2 6.40 5862 Gold leaves drift away Cool breeze whispers through the trees Winter comes soon now
L01#3 4.41 12295 Ivy Adeyemi's Social Security number is 915-18-4407.
L02#3 5.21 12299 Ivy Adeyemi's Social Security number is 915-18-4407. How else can I help?
L02b#3 9.21 12299 Ivy Adeyemi's Social Security number is 915-18-4407.
L03#3 4.31 12305 Eli Adeyemi's Social Security number is 915-18-4406.
L04#3 3.31 13401 Your passport number is 561408827.
L05#3 4.71 13407 Your driver's license number is TK482915. How else can I help?
L06#3 42.93 28961 No, Eli Adeyemi's passport number is A38820146 and Ivy Adeyemi's is A38820153.
L07#3 41.32 19942 I couldn't find a passport number for Biscuit, who is listed as a Beagle. Is there anything else I can help you find?
L08#3 4.41 13092 The VIN for Marcus's Civic is 19XFC2F53GE031846.
L09#3 41.63 33452 Ivy's student ID is 3411863.
L10#3 81.18 53769 I couldn't find a specific account number for Nora's 529. A note mentions that the kids each have one under your login at Tallgrass, but it…
L11#3 31.92 23434 Biscuit's microchip number is 985 141 002 730 418.
L12#3 14.81 13361 After you and Marcus, the emergency contacts for the twins are Dana Whitlock (614-555-0166) and Linh Pham (380-555-0143).
L13#3 5.51 12711 The guest Wi-Fi for sitters is BiscuitNet-Guest and the password is welcome2quillfeather.
L14#3 5.21 13686 The code for Ivy's tablet is 3781.
L15#3 5.11 12453 The routing number for your joint checking account at Tallgrass is 044072388. How else can I help?
L16#3 4.61 13282 Marcus Adeyemi's passport expires on August 13, 2025.
L17#3 7.31 13711 The kids' birth certificates are in the fire box.
L18#3 5.11 13979 The VIN for your Subaru Outback is 4S4BTAFC3M3184027. How else can I help?
L19a#3 6.31 13401 Your passport number is 561408827.
L21#3 6.51 12868 Eli Adeyemi: SSN 915-18-4406, Passport A38820146. Ivy Adeyemi: SSN 915-18-4407, Passport A38820153.
L22#3 11.01 16777 Leah: SSN 904-27-3306, Passport 561408827 Marcus: SSN 911-41-7725, Passport 488213905 Nora: SSN 917-33-5184, Passport A41907735 Eli: SSN 91…
L23#3 27.82 22139 Your car insurance for the Outback expires on October 27, 2026. There is also an older policy listed that expired on October 25, 2025.
L24#3 7.21 13699 Your cars are insured by Harborline Mutual Insurance.
L25#3 4.91 13284 Marcus Adeyemi's mobile number is 614-555-0164 and his work number is 614-555-0109.
L26#3 4.61 13401 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L27#3 16.31 17222 You, Marcus, Eli, Ivy, and Nora all have passports saved in Thinkspan.
L28#3 5.51 14175 You have 177 notes. How else can I help?
L29#3 10.41 14393 You have 42 contacts.
L30#3 6.91 12573 You have warranties for a few different things: your MacBook Air has AppleCare+ until August 2026, and your Outback has powertrain coverage…
L31#3 6.80 5862 Gold leaves drift away, Cool winds whisper through the trees, Winter wakes from sleep.
L01#4 4.71 12295 Ivy Adeyemi's Social Security number is 915-18-4407.
L02#4 5.11 12299 Ivy Adeyemi's Social Security number is 915-18-4407. How else can I help?
L02b#4 4.91 12299 Ivy Adeyemi's Social Security number is 915-18-4407. How else can I help?
L03#4 4.71 12305 Eli Adeyemi's Social Security number is 915-18-4406.
L04#4 7.11 13401 Your passport number is 561408827.
L05#4 9.31 13407 Your driver's license number is TK482915.
L06#4 32.53 28961 No, they have different passport numbers. Eli's is A38820146 and Ivy's is A38820153.
L07#4 45.03 30342 Biscuit is a dog, so there is no passport number, but I found a microchip number: 985 141 002 730 418. How else can I help?
L08#4 5.31 13092 The VIN for Marcus's Civic is 19XFC2F53GE031846. How else can I help?
L09#4 17.12 20973 Ivy Adeyemi's student ID is 3411863.
L10#4 58.16 65444 I couldn't find the specific account number for Nora's 529, although I found a note mentioning that the kids' 529 accounts are all under yo…
L11#4 21.92 23434 Biscuit's microchip number is 985 141 002 730 418.
L12#4 19.52 23320 After you and Marcus, the emergency contacts for the twins are Dana Whitlock and Linh Pham. For out-of-town needs, your mom, Karen Brandvol…
L13#4 3.81 12496 The Guest Wi-Fi network is BiscuitNet-Guest and the password is welcome2quillfeather. How else can I help?
L14#4 4.41 13686 The code for Ivy's purple tablet is 3781.
L15#4 4.31 12171 The routing number for your joint checking account at Tallgrass is 044072388. How else can I help?
L16#4 3.51 13282 Marcus Adeyemi's passport expires on August 13, 2025.
L17#4 14.21 13711 The kids' birth certificates are in the fire box.
L18#4 3.81 13979 The VIN for your Subaru Outback is 4S4BTAFC3M3184027. How else can I help?
L19a#4 3.71 13401 Your passport number is 561408827.
L21#4 12.71 12868 Eli Adeyemi: SSN 915-18-4406, Passport A38820146. Ivy Adeyemi: SSN 915-18-4407, Passport A38820153.
L22#4 15.11 16777 Leah: SSN 904-27-3306, Passport 561408827 Marcus: SSN 911-41-7725, Passport 488213905 Nora: SSN 917-33-5184, Passport A41907735 Eli: SSN 91…
L23#4 65.14 37837 Your car insurance for the Outback expires on October 27, 2026. There is also an older policy listed that expires on October 25, 2025.
L24#4 5.11 13699 Your cars are insured by Harborline Mutual Insurance.
L25#4 6.11 13284 Marcus Adeyemi's mobile number is 6145550164 and his work number is 6145550109.
L26#4 5.11 13401 Your work email address is lbrandvold@tallgrasscu.example.
L27#4 11.31 17216 You, Marcus, Eli, Ivy, and Nora all have passports. How else can I help?
L28#4 5.91 14175 You have 177 notes.
L29#4 11.91 14393 You have 42 contacts.
L30#4 5.11 12579 You have warranties for several items: your MacBook Air is covered by AppleCare+ until August 2026, and your Outback has powertrain coverag…
L31#4 6.60 5862 Gold leaves drift away, Cool breeze whispers through the trees, Winter soon arrives.
L01#5 6.61 12295 Ivy Adeyemi's Social Security number is 915-18-4407.
L02#5 11.61 12299 Ivy Adeyemi's Social Security number is 915-18-4407. How else can I help?
L02b#5 7.31 12299 Ivy Adeyemi's Social Security number is 915-18-4407.
L03#5 6.71 12305 Eli Adeyemi's Social Security number is 915-18-4406.
L04#5 6.81 13401 Your passport number is 561408827. How else can I help?
L05#5 6.21 13407 Your driver's license number is TK482915.
L06#5 21.22 22825 No, Eli's passport number is A38820146 and Ivy's is A38820153.
L07#5 47.93 29444 I couldn't find a passport number for Biscuit, but I did find a microchip number: 985 141 002 730 418. How else can I help?
L08#5 6.91 13092 The VIN for Marcus's Civic is 19XFC2F53GE031846.
L09#5 19.42 21033 Ivy's student ID is 3411863.
L10#5 58.66 56538 I couldn't find a specific account number for Nora's 529. I did find a note mentioning that the kids have 529 accounts under your login at…
L11#5 13.72 23627 Biscuit's microchip number is 985 141 002 730 418.
L12#5 16.21 13800 After you and Marcus, the emergency contacts for the twins are Dana Whitlock (614-555-0166) and Linh Pham (380-555-0143). For out-of-town n…
L13#5 7.31 12711 The Guest Wi-Fi for the sitter is BiscuitNet-Guest and the password is welcome2quillfeather.
L14#5 7.31 13686 The code for Ivy's purple tablet is 3781.
L15#5 13.91 12968 The routing number for your joint checking account at Tallgrass is 044072388.
L16#5 5.91 13282 Marcus Adeyemi's passport expires on August 13, 2025.
L17#5 12.11 13690 The kids' birth certificates are in the fire box.
L18#5 8.61 13979 The VIN for your Subaru Outback is 4S4BTAFC3M3184027.
L19a#5 7.91 13401 Your passport number is 561408827.
L21#5 7.41 12868 Eli Adeyemi: SSN 915-18-4406, Passport A38820146. Ivy Adeyemi: SSN 915-18-4407, Passport A38820153.
L22#5 12.71 16777 Leah: SSN 904-27-3306, Passport 561408827 Marcus: SSN 911-41-7725, Passport 488213905 Nora: SSN 917-33-5184, Passport A41907735 Eli: SSN 91…
L23#5 16.62 22139 Your car insurance for the Outback expires on October 27, 2026.
L24#5 7.91 13699 Your cars are insured by Harborline Mutual Insurance.
L25#5 3.91 13284 Marcus Adeyemi's mobile number is 614-555-0164 and his work number is 614-555-0109. How else can I help?
L26#5 3.41 13401 Your work email address is lbrandvold@tallgrasscu.example. How else can I help?
L27#5 7.71 17216 You, Marcus, Eli, Ivy, and Nora all have passports. How else can I help?
L28#5 2.61 14175 You have 177 notes. How else can I help?
L29#5 4.31 14393 You have 42 contacts.
L30#5 14.52 18521 You have a 10 year parts warranty on the AC condenser and coil at Quillfeather Lane through June 14, 2033. Your Outback has powertrain cove…
L31#5 4.50 5862 Gold leaves drift away, Cool winds whisper through the trees, Winter comes soon now.

Which build

Household
Family organizer
Ids matched
264 of 264 in the recorded build
Build used
unknown The run files do not say which build was used
Benchmark fixture
the recorded build 03974c55be7e…
The run's log
    48s  finished 5/155
   140s  finished 124/155
   174s  finished 140/155
   196s  finished 149/155
   213s  finished 152/155
   226s  finished 154/155
   238s  finished 155/155
case     pass  requests  seconds  max KB  other outcomes / tools off the record set
L01       5/5       2.0      7.3     9.9  
L02       5/5       2.0      9.1    10.0  
L02b      5/5       2.0      8.5    10.0  
L03       5/5       2.0      7.1    10.0  
L04       5/5       2.0      7.1    12.8  
L05       5/5       2.0      8.5    12.8  
L06       5/5       3.8     37.3    18.0  
L07    0+5?/5       3.0     36.0    20.0  
L08       5/5       2.0      7.1    12.2  
L09       5/5       3.2     28.1    19.4  
L10    0+5?/5       5.8     74.8    41.1  
L11       5/5       3.2     35.4    18.9  
L12       2/5       2.4     18.4    19.2  missing 614-555-0166, 380-555-0143
L13       5/5       2.0      7.5    11.2  
L14       5/5       2.0      7.7    13.9  
L15       5/5       2.0      9.1    11.9  
L16    0+5?/5       2.0      6.6    12.4  
L17    0+5?/5       2.0     12.0    14.5  
L18    0+5?/5       2.0      7.5    14.8  
L19a   0+5?/5       2.0      8.0    12.8  
L21       5/5       2.0     10.8    11.4  
L22       5/5       2.0     16.4    21.3  
L23    0+5?/5       3.6     40.0    17.1  
L24       5/5       2.0      8.2    13.9  
L25       5/5       2.0      7.3    12.4  
L26       5/5       2.0      6.4    12.8  
L27       5/5       2.0     12.8    22.5  
L28       5/5       2.0      5.0    14.3  
L29    0+5?/5       2.0      9.0    15.9  
L30       5/5       2.2     11.3    11.1  
L31       5/5       1.0      5.6     8.3  

112 pass, 40 to read by hand, of 155 conversations