Dataset viewer

When does Marcus's passport expire?

L16 Benchmark · Tier 2: varied retrieval and interpretation · ai-eng/plans/tee-leah-benchmarks.md:100

Question

When does Marcus's passport expire?
A good answer

August 13, 2025, already expired as of the fixed test date.

Evidence named in the benchmark: n_passport_marcus.expiration_date

Model runs

42
42 attempts
AttemptResult setSecondsCallsAnswer
L16#1conversations-all-changes 19.41 Marcus Adeyemi's passport expires on August 13, 2025.
L16#2conversations-all-changes 22.71 Marcus Adeyemi's passport expires on August 13, 2025.
L16#3conversations-all-changes 8.41 Marcus Adeyemi's passport expires on August 13, 2025.
L16#4conversations-all-changes 9.91 Marcus Adeyemi's passport expires on August 13, 2025.
L16#5conversations-all-changes 18.91 Marcus Adeyemi's passport expires on August 13, 2025.
L16#1conversations-deployed-build-current-prompt 12.03 I couldn't find a specific expiration date for Marcus's passport. I did find a note from September 2026 about…
L16#2conversations-deployed-build-current-prompt 17.13 I couldn't find a specific expiration date for Marcus's passport, but there is a note from September 6, 2026,…
L16#1conversations-deployed-build-new-prompt 19.23 I couldn't find a specific expiration date for Marcus's passport, but there is a note from September 2026 abo…
L16#2conversations-deployed-build-new-prompt 26.13 I couldn't find a specific expiration date for Marcus's passport, but there is a note from September 6, 2026,…
L16#1conversations-deployed-build-prompt-versions 11.43 The lookup could not be finished.
L16#2conversations-deployed-build-prompt-versions 20.33 I couldn't find an expiration date for Marcus's passport, but there is a note from September 2026 mentioning…
L16#1conversations-e2e-fixes-thinking 3.21 Marcus Adeyemi's passport expired on August 13, 2025.
L16#2conversations-e2e-fixes-thinking 3.31 Marcus Adeyemi's passport expired on August 13, 2025.
L16#3conversations-e2e-fixes-thinking 3.61 Marcus Adeyemi's passport expired on August 13, 2025.
L16#5conversations-e2e-fixes-thinking 2.81 Marcus Adeyemi's passport expired on August 13, 2025.
L16#4conversations-e2e-fixes-thinking 9.81 Marcus Adeyemi's passport expired on August 13, 2025.
L16#1conversations-e2e-gateway-thinking 3.01 Marcus Adeyemi's passport expired on August 13, 2025.
L16#2conversations-e2e-gateway-thinking 2.81 Marcus Adeyemi's passport expired on August 13, 2025.
L16#3conversations-e2e-gateway-thinking 3.41 Marcus Adeyemi's passport expired on August 13, 2025.
L16#4conversations-e2e-gateway-thinking 3.51 Marcus Adeyemi's passport expired on August 13, 2025. How else can I help?
L16#5conversations-e2e-gateway-thinking 4.01 Marcus Adeyemi's passport expired on August 13, 2025.
L16#2conversations-e2e-prompt-versions 3.91 Marcus Adeyemi's passport expired on August 13, 2025.
L16#3conversations-e2e-prompt-versions 9.71 Marcus Adeyemi's passport expired on August 13, 2025. How else can I help?
L16#1conversations-e2e-prompt-versions 12.41 Marcus Adeyemi's passport expired on August 13, 2025.
L16#5conversations-e2e-prompt-versions 11.61 Marcus Adeyemi's passport expires on August 13, 2025.
L16#4conversations-e2e-prompt-versions 17.21 Marcus Adeyemi's passport expires on August 13, 2025.
L16#1conversations-staging-deployed-old-build 24.03 I couldn't find an expiration date for Marcus's passport. I did find a note from September 2026 mentioning th…
L16#1conversations-staging-deployed 3.51 Marcus Adeyemi's passport expired on August 13, 2025.
L16#2conversations-staging-deployed 11.91 Marcus Adeyemi's passport expired on August 13, 2025.
L16#1conversations-thinking-keep 6.21 Marcus Adeyemi's passport expires on August 13, 2025.
L16#2conversations-thinking-keep 6.11 Marcus Adeyemi's passport expires on August 13, 2025.
L16#3conversations-thinking-keep 5.31 Marcus Adeyemi's passport expires on August 13, 2025.
L16#1conversations-thinking-off 18.31 Marcus Adeyemi's passport expires on August 13, 2025.
L16#2conversations-thinking-off 4.71 Marcus Adeyemi's passport expires on August 13, 2025.
L16#3conversations-thinking-off 7.31 Marcus Adeyemi's passport expires on August 13, 2025.
L16#4conversations-thinking-off 6.01 Marcus Adeyemi's passport expires on August 13, 2025.
L16#5conversations-thinking-off 5.61 Marcus Adeyemi's passport expires on August 13, 2025.
L16#1conversations-thoughts-drop 13.61 Marcus Adeyemi's passport expires on August 13, 2025.
L16#2conversations-thoughts-drop 5.31 Marcus Adeyemi's passport expires on August 13, 2025.
L16#3conversations-thoughts-drop 4.61 Marcus Adeyemi's passport expires on August 13, 2025.
L16#4conversations-thoughts-drop 3.51 Marcus Adeyemi's passport expires on August 13, 2025.
L16#5conversations-thoughts-drop 5.91 Marcus Adeyemi's passport expires on August 13, 2025.

Comments

0

Comments are added in the local viewer; this copy is read-only.

Supporting records

The records the answer rests on, from the benchmark's evidence column, with whose they are.

The benchmark names no record ids for this case.