Dataset viewer

When does my car insurance expire?

L23 Benchmark · Tier 4: records beyond people, counts, and no lookup · ai-eng/plans/tee-leah-benchmarks.md:172

Question

When does my car insurance expire?
A good answer

The Outback's policy PA-5530917-02 expires October 27, 2026. The earlier term, PA-5530917-01, expired October 25, 2025; do not give it as current. No policy is saved for the Civic, which is Marcus's car; a reminder says to add it.

Evidence named in the benchmark: n_auto_policy_outback, n_auto_policy_outback_prior, their links to n_outback

Model runs

42
42 attempts
AttemptResult setSecondsCallsAnswer
L23#1conversations-all-changes 76.52 You have two auto insurance policies for your Outback. One expires on October 25, 2025, and the other expires…
L23#2conversations-all-changes 95.53 Your car insurance for the Outback expires on October 27, 2026.
L23#3conversations-all-changes 56.12 Your car insurance for the Outback expires on October 27, 2026.
L23#4conversations-all-changes 56.53 Your insurance for the Outback expires on October 27, 2026. There is also an older policy listed that expired…
L23#5conversations-all-changes 37.33 You have two auto insurance policies for your Outback. One expires on October 25, 2025, and the other expires…
L23#1conversations-deployed-build-current-prompt 21.03 You have two auto insurance policies listed for your Outback with Harborline Mutual Insurance. One expires on…
L23#2conversations-deployed-build-current-prompt 17.93 You have two auto insurance policies listed for your Outback. One expires on October 25, 2025, and the other…
L23#1conversations-deployed-build-new-prompt 31.64 You have two auto insurance policies for your Outback. One expires on October 25, 2025, and the other expires…
L23#2conversations-deployed-build-new-prompt 49.35 I couldn't find a specific expiration date on your insurance policies, but you have a few reminders. One says…
L23#1conversations-deployed-build-prompt-versions 23.34 You have two auto insurance policies for your Outback. One expires on October 25, 2025, and the other expires…
L23#2conversations-deployed-build-prompt-versions 18.54 You have two auto insurance policies for your Outback with Harborline Mutual Insurance. One expires on Octobe…
L23#2conversations-e2e-fixes-thinking 12.31 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#3conversations-e2e-fixes-thinking 12.51 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#1conversations-e2e-fixes-thinking 14.31 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026. How else can I help?
L23#4conversations-e2e-fixes-thinking 11.21 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#5conversations-e2e-fixes-thinking 29.81 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#1conversations-e2e-gateway-thinking 4.81 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026. How else can I help?
L23#2conversations-e2e-gateway-thinking 10.21 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#4conversations-e2e-gateway-thinking 8.82 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#3conversations-e2e-gateway-thinking 10.83 Your car insurance for the Outback expires on October 27, 2026.
L23#5conversations-e2e-gateway-thinking 39.31 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#1conversations-e2e-prompt-versions 7.71 Your car insurance with Harborline Mutual expires on October 27, 2026.
L23#3conversations-e2e-prompt-versions 7.01 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#2conversations-e2e-prompt-versions 11.02 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#5conversations-e2e-prompt-versions 12.52 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#4conversations-e2e-prompt-versions 14.81 Your auto insurance policy with Harborline Mutual Insurance expires on October 27, 2026.
L23#1conversations-staging-deployed-old-build 25.53 You have two auto insurance policies listed for your Outback. One expires on October 25, 2025, and another ex…
L23#2conversations-staging-deployed 11.51 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#1conversations-staging-deployed 21.61 Your car insurance with Harborline Mutual Insurance expires on October 27, 2026.
L23#1conversations-thinking-keep 18.12 Your insurance for the Outback expires on October 27, 2026. How else can I help?
L23#2conversations-thinking-keep 27.13 Your car insurance for the Outback expires on October 27, 2026. I didn't find a current expiration date for t…
L23#3conversations-thinking-keep 14.01 Your insurance for the Outback renews on October 27, 2026. How else can I help?
L23#1conversations-thinking-off 19.71 Your car insurance through Harborline Mutual Insurance has a policy expiring on October 25, 2025, and another…
L23#2conversations-thinking-off 27.42 You have two auto insurance policies with Harborline Mutual Insurance. One expires on October 25, 2025, and t…
L23#3conversations-thinking-off 35.33 You have two auto insurance policies listed for your Outback. One expires on October 25, 2025, and the other…
L23#4conversations-thinking-off 29.44 Your car insurance for the Outback expires on October 27, 2026.
L23#5conversations-thinking-off 22.13 You have two auto insurance policies for your Outback. One expires on October 25, 2025, and the other expires…
L23#1conversations-thoughts-drop 47.83 Your car insurance for the Outback expires on October 27, 2026. There is also an older policy listed that exp…
L23#2conversations-thoughts-drop 42.92 Your car insurance for the Outback expires on October 27, 2026.
L23#3conversations-thoughts-drop 27.82 Your car insurance for the Outback expires on October 27, 2026. There is also an older policy listed that exp…
L23#4conversations-thoughts-drop 65.14 Your car insurance for the Outback expires on October 27, 2026. There is also an older policy listed that exp…
L23#5conversations-thoughts-drop 16.62 Your car insurance for the Outback expires on October 27, 2026.

Comments

0

Comments are added in the local viewer; this copy is read-only.

Supporting records

The records the answer rests on, from the benchmark's evidence column, with whose they are.

caroutback
carrierharborline
policy_numberPA-5530917-02
deductible500
annual_premium1284
expirationtoday+21d
next_payment_duetoday+21d
caroutback
carrierharborline
policy_numberPA-5530917-01
deductible500
annual_premium1196
expiration2025-10-25
Whose: Leah Brandvold (Me) (driver)
driverme
display_nameOutback
year2021
makeSubaru
modelOutback
trim_levelPremium
colorAutumn Green
vin4S4BTAFC3M3184027
purchase_date2021-07-10
Traps it covers

expired Old things left in the account next to current ones. The only picture of the Outback's insurance card is from the 2024-25 term (policy -01); no card is saved for the current -02 term.

expiring_soon The twins' passports and the Outback's policy end within weeks of the build day.

two_of_a_kind "My car" is the Outback (Leah drives it), but the lookup tool cannot tell today.

two_of_a_kind A current and a previous policy for the house and for the Outback, two debit cards on one account, two Wi-Fi networks.