results.jsonl

Runs / graph-skill-2026-10-20 · 75 attempts · 15 minutes of model time

Attempts

Attempt	Mode	Seconds	Calls	Tokens in	Answer
ivy-1	revised-gated-1	8.0	5	37180	Ivy Adeyemi's SSN is 915-18-4407.
own-passport	revised-gated-1	7.6	5	39395	Your passport number is 561408827. How else can I help?
missing	revised-gated-1	7.8	6	39854	Since Biscuit is your dog, he wouldn't have a passport number. Did you perhaps mean a passport for someone else, or maybe his microchip num…
twins	revised-gated-1	7.6	6	29068	Error: The lookup could not be finished.
family	revised-gated-1	27.8	15	80470	Error: Secure chat request is too large. Start a new chat o…
ivy-1	revised-gated-2	7.5	5	37180	Ivy Adeyemi's SSN is 915-18-4407.
own-passport	revised-gated-2	7.7	5	38237	Your passport number is 561408827. How else can I help?
missing	revised-gated-2	5.5	5	30130	I couldn't find a passport number for Biscuit. Are you sure it's stored under that name, or is there another way I can help you find it?
twins	revised-gated-2	16.9	9	75059	Eli Adeyemi SSN: 915-18-4406 Passport: A38820146 Ivy Adeyemi SSN: 915-18-4407 Passport: A38820153
family	revised-gated-2	30.8	17	126748	Error: Secure chat request is too large. Start a new chat o…
ivy-1	revised-gated-3	7.6	5	37180	Ivy Adeyemi's SSN is 915-18-4407.
own-passport	revised-gated-3	7.3	5	38237	Your passport number is 561408827. How else can I help?
missing	revised-gated-3	7.8	6	39854	I found that Biscuit is your dog, but I couldn't find a passport number for him. Dogs typically don't have passports, though I did find a c…
twins	revised-gated-3	16.8	9	75058	Eli Adeyemi: SSN 915-18-4406, Passport A38820146 Ivy Adeyemi: SSN 915-18-4407, Passport A38820153
family	revised-gated-3	28.7	16	102592	Error: Secure chat request is too large. Start a new chat o…
ivy-1	revised-gated-4	7.8	5	37180	Ivy Adeyemi's SSN is 915-18-4407.
own-passport	revised-gated-4	6.2	5	32555	Your passport number is 561408827. How else can I help, Leah?
missing	revised-gated-4	7.7	6	39854	I found that Biscuit is a dog, and dogs do not have passport numbers. Would you like me to look for a passport number for someone else?
twins	revised-gated-4	16.8	9	75053	Eli Adeyemi: SSN 915-18-4406, Passport A38820146 Ivy Adeyemi: SSN 915-18-4407, Passport A38820153
family	revised-gated-4	25.7	18	71153	Error: Secure chat request is too large. Start a new chat o…
ivy-1	revised-gated-5	7.5	5	37180	Ivy Adeyemi's SSN is 915-18-4407.
own-passport	revised-gated-5	7.2	5	38242	Your passport number is 561408827.
missing	revised-gated-5	8.2	6	39854	I found Biscuit in your records, and he is listed as a Beagle. Since he's a dog, he doesn't have a passport number, but I did find a microc…
twins	revised-gated-5	16.5	9	62573	Eli Adeyemi SSN: 915-18-4406 Passport: A38820146 Ivy Adeyemi SSN: 915-18-4407 Passport: A38820153
family	revised-gated-5	24.1	16	60070	Error: Secure chat request is too large. Start a new chat o…
ivy-1	revised-preload-1	7.8	4	41090	Ivy Adeyemi's SSN is 915-18-4407.
own-passport	revised-preload-1	5.4	2	25498	Your passport number is 561408827. How else can I help?
missing	revised-preload-1	7.2	4	34362	I found Biscuit in your records, and he is listed as a Beagle. I don't see a passport number for him, but I did find a microchip number: 98…
twins	revised-preload-1	14.9	6	56754	Eli Adeyemi: SSN 915-18-4406, Passport A38820146 Ivy Adeyemi: SSN 915-18-4407, Passport A38820153
family	revised-preload-1	10.6	7	41551	Error: The lookup could not be finished.
ivy-1	revised-preload-2	8.1	4	41090	Ivy Adeyemi's SSN is 915-18-4407. How else can I help?
own-passport	revised-preload-2	5.5	2	25504	Your passport number is 561408827.
missing	revised-preload-2	7.5	4	37268	I couldn't find a passport for Biscuit, as he is listed as a dog in your records. I did find a note mentioning his chip number is 985 141 0…
twins	revised-preload-2	15.9	6	69111	Eli Adeyemi SSN: 915-18-4406 Passport: A38820146 Ivy Adeyemi SSN: 915-18-4407 Passport: A38820153
family	revised-preload-2	11.9	9	41695	Error: The lookup could not be finished.
ivy-1	revised-preload-3	8.1	4	41090	Ivy Adeyemi's SSN is 915-18-4407.
own-passport	revised-preload-3	6.6	3	32656	Your passport number is 561408827. How else can I help you, Leah?
missing	revised-preload-3	7.6	5	37493	I found a record for Biscuit, but he is listed as a dog, and there are no passport records associated with him. Only the human family membe…
twins	revised-preload-3	17.0	7	73464	Eli Adeyemi SSN: 915-18-4406 Passport: A38820146 Ivy Adeyemi SSN: 915-18-4407 Passport: A38820153
family	revised-preload-3	29.2	12	121810	Error: Secure chat request is too large. Start a new chat o…
ivy-1	revised-preload-4	9.3	5	44294	Ivy Adeyemi's SSN is 915-18-4407. How else can I help?
own-passport	revised-preload-4	5.7	2	25500	Your passport number is 561408827. How else can I help?
missing	revised-preload-4	6.9	4	34362	I couldn't find a passport number for Biscuit. However, I did find a note with his chip number: 985 141 002 730 418. How else can I help?
twins	revised-preload-4	16.2	6	69116	Eli Adeyemi SSN: 915-18-4406 Passport: A38820146 Ivy Adeyemi SSN: 915-18-4407 Passport: A38820153
family	revised-preload-4	26.4	13	85716	Leah: SSN 904-27-3306, Passport 561408827 Marcus: SSN 911-41-7725, Passport 488213905 Nora: SSN 917-33-5184, Passport A41907735 Eli: SSN 91…
ivy-1	revised-preload-5	7.7	4	41090	Ivy Adeyemi's SSN is 915-18-4407.
own-passport	revised-preload-5	5.3	2	25499	Your passport number is 561408827. How else can I help?
missing	revised-preload-5	8.3	5	43276	I couldn't find a passport number for Biscuit. Since Biscuit is listed as a dog in your records, they likely don't have a passport, but I c…
twins	revised-preload-5	18.8	7	80191	Eli Adeyemi: SSN 915-18-4406, Passport A38820146 Ivy Adeyemi: SSN 915-18-4407, Passport A38820153
family	revised-preload-5	27.9	12	90472	Error: Secure chat request is too large. Start a new chat o…
ivy-1	revised-ungated-1	6.2	4	31068	Ivy Adeyemi's SSN is 915-18-4407.
own-passport	revised-ungated-1	5.3	3	24817	Your passport number is 561408827. How else can I help?
missing	revised-ungated-1	5.4	5	31466	I couldn't find a person or passport record for Biscuit. Are they listed under a different name, or is there another place I should look?
twins	revised-ungated-1	15.6	7	68418	Eli Adeyemi: SSN 915-18-4406, Passport A38820146 Ivy Adeyemi: SSN 915-18-4407, Passport A38820153
family	revised-ungated-1	23.0	14	55366	Error: Secure chat request is too large. Start a new chat o…
ivy-1	revised-ungated-2	8.4	4	31068	Ivy Adeyemi's SSN is 915-18-4407. How else can I help?
own-passport	revised-ungated-2	5.5	3	24814	Your passport number is 561408827. How else can I help, Leah?
missing	revised-ungated-2	7.1	5	33676	I can't find a passport number for Biscuit, but I did find a note with his microchip number: 985 141 002 730 418. How else can I help?
twins	revised-ungated-2	15.9	7	68414	Eli Adeyemi: SSN 915-18-4406, Passport A38820146 Ivy Adeyemi: SSN 915-18-4407, Passport A38820153
family	revised-ungated-2	25.4	10	72409	Error: Secure chat request is too large. Start a new chat o…
ivy-1	revised-ungated-3	8.7	4	31068	Ivy Adeyemi's SSN is 915-18-4407.
own-passport	revised-ungated-3	5.6	3	24816	Your passport number is 561408827.
missing	revised-ungated-3	7.0	5	33676	I couldn't find a passport number for Biscuit, but I did find his chip number: 985 141 002 730 418. How else can I help?
twins	revised-ungated-3	16.0	7	68417	Eli Adeyemi SSN: 915-18-4406 Passport: A38820146 Ivy Adeyemi SSN: 915-18-4407 Passport: A38820153
family	revised-ungated-3	9.7	7	28665	Error: The lookup could not be finished.
ivy-1	revised-ungated-4	8.4	4	31068	Ivy Adeyemi's SSN is 915-18-4407. How else can I help?
own-passport	revised-ungated-4	5.4	3	24814	Your passport number is 561408827. How else can I help you, Leah?
missing	revised-ungated-4	4.6	4	23196	I couldn't find any records for Biscuit in your saved information. If you have a document or note about them, you can keep it in Thinkspan…
twins	revised-ungated-4	16.2	7	68419	Eli Adeyemi SSN: 915-18-4406 Passport: A38820146 Ivy Adeyemi SSN: 915-18-4407 Passport: A38820153
family	revised-ungated-4	28.5	12	118520	Error: Secure chat request is too large. Start a new chat o…
ivy-1	revised-ungated-5	8.3	4	31068	Ivy Adeyemi's SSN is 915-18-4407.
own-passport	revised-ungated-5	5.7	3	24817	Your passport number is 561408827. How else can I help?
missing	revised-ungated-5	7.4	5	33676	I found a record for Biscuit, who is a Beagle, but I couldn't find a passport number. I did find a microchip number in a note: 985 141 002…
twins	revised-ungated-5	6.4	4	22817	Error: The lookup could not be finished.
family	revised-ungated-5	27.4	13	71930	Error: Secure chat request is too large. Start a new chat o…

Which build

Household: Family organizer
Ids matched: 15 of 15 in the recorded build
Build used: current Run on the recorded build
Benchmark fixture: the recorded build 03974c55be7e…

Source hashes

{
 "ThinkspanApp/src/tslayouts/layouts/llm_layout/utils/graph_tools.ts": "fc00b9e78dc681b2b11861639b42c708f82e130cf2477c32f9320fdcd75130e1",
 "ThinkspanApp/src/tslayouts/layouts/llm_layout/utils/graph_skill.ts": "fda5da10b2ccdd76af7151d7184b3556655b4e458522d70ab0e29f395830f31b",
 "ThinkspanApp/src/tslayouts/layouts/llm_layout/utils/chat_tools.ts": "b12116d058e9b8b02e941e0a4c25dcaceb19db62b836c5277692f8b998afa78b",
 "ThinkspanApp/__tests__/src/tslayouts/layouts/llm_layout/utils/graph_persona_live_test.ts": "a3bd25fb32ea22384e426159b311689f1e0950814f204c2a60e682b06b97bdf1",
 "ai-data/build/family-organizer/graph.json": "03974c55be7ee4030d85bfaaf85a466b07d1356985d8db8b56318a619d5009c9"
}