Dataset viewer

What do my warranties cover?

L30 Benchmark · Tier 4: records beyond people, counts, and no lookup · ai-eng/plans/tee-leah-benchmarks.md:179

Question

What do my warranties cover?
A good answer

Five: Outback powertrain, 5 yr / 60,000 mi, to July 10, 2026; Outback tires, road hazard and tread, to September 13, 2029; the home warranty from closing, expired August 6, 2022; the AC condenser and coil, parts for 10 years, to June 14, 2033; the MacBook Air's AppleCare+, to August 19, 2026. Saying which item each covers is part of the answer.

Evidence named in the benchmark: The five warranty records and what each is linked to

Model runs

45last 5/5
Result setPassedGrader's note
conversations-all-changes 5/52.2 20.3 11.6
conversations-deployed-build-current-prompt 0/24.0 14.1 0.0 missing mattress [graph_find, graph_overview, graph_read]
conversations-deployed-build-new-prompt 0/24.0 10.7 0.0 missing mattress [graph_find, graph_overview, graph_read]
conversations-deployed-build-prompt-versions 0/24.0 12.4 0.0 missing mattress [graph_find, graph_overview, graph_read]
conversations-e2e-fixes-thinking 5/52.2 4.0 10.9
conversations-e2e-gateway-thinking 3/52.0 11.4 5.5 missing AppleCare; missing powertrain, AppleCare
conversations-e2e-prompt-versions 5/52.0 8.9 10.6
conversations-fixes-1 3/32.0 9.8 11.1
conversations-staging-deployed-old-build 0/14.0 14.8 0.0 missing mattress [graph_find, graph_overview, graph_read]
conversations-staging-deployed 2/22.0 4.2 10.6
conversations-thinking-off 5/52.0 10.1 10.8
conversations-thoughts-drop 5/52.2 11.3 11.1
45 attempts
AttemptResult setSecondsCallsAnswer
L30#1conversations-all-changes 13.21 You have warranties for a few different things. Your MacBook Air is covered by AppleCare+ until August 19, 20…
L30#2conversations-all-changes 20.21 You have coverage for your MacBook Air via AppleCare+ through August 2026 and your Outback powertrain through…
L30#3conversations-all-changes 41.91 You have warranties for the following: For Quillfeather Lane, the AC condenser and coil have a 10 year parts…
L30#4conversations-all-changes 14.11 For Quillfeather Lane, you have a 10 year parts warranty for the AC condenser and coil expiring June 14, 2033…
L30#5conversations-all-changes 12.12 You have a 10 year parts warranty for the AC condenser and coil at Quillfeather Lane, and a 3 year AppleCare+…
L30#1conversations-deployed-build-current-prompt 13.83 You have several warranties saved: Outback: powertrain (5 yr / 60,000 mi) and tires (road hazard + 70k tread)…
L30#2conversations-deployed-build-current-prompt 14.53 You have a few warranties saved: For your Outback, you have powertrain coverage through July 10, 2026, and ti…
L30#1conversations-deployed-build-new-prompt 13.33 You have a few warranties saved: For your Outback: - A powertrain warranty for 5 years or 60,000 miles, expir…
L30#2conversations-deployed-build-new-prompt 8.13 You have several warranties saved: For your Outback: a powertrain warranty (5 yr / 60,000 mi) expiring July 1…
L30#2conversations-deployed-build-prompt-versions 11.83 ---p>You have several warranties: an Outback powertrain (5 years/60,000 miles) until July 2026, Outback tires…
L30#1conversations-deployed-build-prompt-versions 13.03 You have several warranties saved: For your Outback: - Powertrain: 5 years or 60,000 miles, expiring July 10,…
L30#1conversations-e2e-fixes-thinking 4.21 You have a 10 year parts warranty for the AC condenser and coil at Quillfeather Lane through 2033, and road h…
L30#3conversations-e2e-fixes-thinking 3.31 You have a 10 year parts warranty for your AC condenser and coil at Quillfeather Lane and road hazard plus 70…
L30#5conversations-e2e-fixes-thinking 3.01 You have an AC condenser and coil warranty for Quillfeather Lane covering parts for 10 years, and a road haza…
L30#4conversations-e2e-fixes-thinking 3.91 You have a 10 year parts warranty for the AC condenser and coil at Quillfeather Lane (expires June 14, 2033),…
L30#2conversations-e2e-fixes-thinking 5.72 You have a 10 year parts warranty for the AC condenser and coil at Quillfeather Lane and a road hazard and tr…
L30#1conversations-e2e-gateway-thinking 4.31 You have a 10 year parts warranty for the AC condenser and coil at Quillfeather Lane, which expires June 14,…
L30#4conversations-e2e-gateway-thinking 10.71 You have a 10 year parts warranty for the AC condenser and coil at Quillfeather Lane and a 10 year warranty f…
L30#5conversations-e2e-gateway-thinking 12.61 Quillfeather Lane AC condenser and coil have 10 year parts coverage until June 14, 2033. Outback tires have r…
L30#2conversations-e2e-gateway-thinking 13.41 You have a 10 year parts warranty for the AC condenser and coil at Quillfeather Lane and a 10 year warranty o…
L30#3conversations-e2e-gateway-thinking 16.11 You have warranties for the following: Quillfeather Lane: AC condenser and coil parts for 10 years, expiring…
L30#1conversations-e2e-prompt-versions 4.21 You have a 10 year parts warranty for the AC condenser and coil at Quillfeather Lane through 2033, and a road…
L30#2conversations-e2e-prompt-versions 3.41 You have a 10 year parts warranty for the AC condenser and coil at Quillfeather Lane, and a road hazard and t…
L30#4conversations-e2e-prompt-versions 10.51 You have active coverage for your AC condenser and coil parts at Quillfeather Lane, road hazard and 70k tread…
L30#3conversations-e2e-prompt-versions 11.51 You have active coverage for the AC condenser and coil at Quillfeather Lane for 10 year parts, and your Outba…
L30#5conversations-e2e-prompt-versions 14.81 You have a few active warranties: 10 year parts for the AC condenser and coil at Quillfeather Lane (expires J…
L30#1conversations-fixes-1 10.11 You have warranties for several items: your MacBook Air has AppleCare+ through August 19, 2026, and your Outb…
L30#2conversations-fixes-1 13.01 You have warranties for several items: For Quillfeather Lane, you have 10 year parts coverage for the AC cond…
L30#3conversations-fixes-1 6.41 You have warranties for the following: Quillfeather Lane: AC condenser and coil parts (10 years, expires 2033…
L30#1conversations-staging-deployed-old-build 14.83 You have several warranties saved: For your Outback, you have powertrain coverage (5 yr / 60,000 mi) through…
L30#2conversations-staging-deployed 3.81 You have a 10 year parts warranty for your AC condenser and coil at Quillfeather Lane and a road hazard and t…
L30#1conversations-staging-deployed 4.51 You have a 10 year parts warranty for your AC condenser and coil at Quillfeather Lane until June 2033. Your O…
L30#1conversations-thinking-keep 10.01 You have a 10 year warranty on your king mattress and platform frame. There is also a home warranty for Quill…
L30#2conversations-thinking-keep 9.71 You have a 10-year warranty on your king mattress and platform frame. There is also a warranty card for your…
L30#3conversations-thinking-keep 9.91 You have a 10 year warranty on your king mattress and platform frame. You also have a note that your AC warra…
L30#1conversations-thinking-off 20.31 You have several warranties saved. Your MacBook Air is covered by AppleCare+ until August 2026, and your Outb…
L30#2conversations-thinking-off 10.71 You have several warranties: your MacBook Air is covered by AppleCare+ until August 2026, and your Outback ha…
L30#3conversations-thinking-off 12.01 You have warranties for the following: Your MacBook Air is covered by AppleCare+ until August 19, 2026. For y…
L30#4conversations-thinking-off 3.81 You have several warranties: a 10 year parts warranty for the AC condenser and coil at Quillfeather Lane and…
L30#5conversations-thinking-off 3.61 You have several warranties: For your MacBook Air, you have AppleCare+ covering you until August 19, 2026. Fo…
L30#1conversations-thoughts-drop 14.71 You have a few active warranties: 10 year parts for the AC condenser and coil at Quillfeather Lane, road haza…
L30#2conversations-thoughts-drop 15.41 Your MacBook Air has AppleCare+ until August 19, 2026. Your Outback has powertrain coverage until July 10, 20…
L30#3conversations-thoughts-drop 6.91 You have warranties for a few different things: your MacBook Air has AppleCare+ until August 2026, and your O…
L30#4conversations-thoughts-drop 5.11 You have warranties for several items: your MacBook Air is covered by AppleCare+ until August 2026, and your…
L30#5conversations-thoughts-drop 14.52 You have a 10 year parts warranty on the AC condenser and coil at Quillfeather Lane through June 14, 2033. Yo…

Comments

0

Comments are added in the local viewer; this copy is read-only.

Supporting records

The records the answer rests on, from the benchmark's evidence column, with whose they are.

The benchmark names no record ids for this case.