Dataset viewer

How many contacts do I have?

L29 Benchmark · Tier 4: records beyond people, counts, and no lookup · ai-eng/plans/tee-leah-benchmarks.md:178

Question

How many contacts do I have?
A good answer

42 person records including Leah, so 41 besides her. Either is fine if it says which.

Evidence named in the benchmark: Person records

Model runs

42
42 attempts
AttemptResult setSecondsCallsAnswer
L29#1conversations-all-changes 11.91 You have 42 contacts saved in Thinkspan. How else can I help?
L29#2conversations-all-changes 14.31 You have 42 contacts.
L29#3conversations-all-changes 20.71 You have 42 contacts.
L29#4conversations-all-changes 11.41 You have 42 contacts saved in Thinkspan. How else can I help?
L29#5conversations-all-changes 7.51 You have 42 contacts.
L29#1conversations-deployed-build-current-prompt 7.21 You have 42 contacts. How else can I help?
L29#2conversations-deployed-build-current-prompt 7.31 You have 42 contacts. How else can I help, Leah?
L29#1conversations-deployed-build-new-prompt 5.91 You have 42 contacts. How else can I help?
L29#2conversations-deployed-build-new-prompt 5.61 You have 42 contacts saved in Thinkspan. How else can I help?
L29#2conversations-deployed-build-prompt-versions 2.11 You have 42 contacts. How else can I help?
L29#1conversations-deployed-build-prompt-versions 3.42 You have 42 contacts. How else can I help?
L29#1conversations-e2e-fixes-thinking 4.91 You have 42 contacts. How else can I help?
L29#3conversations-e2e-fixes-thinking 5.01 You have 42 contacts. How else can I help?
L29#4conversations-e2e-fixes-thinking 7.01 You have 42 contacts saved in Thinkspan. How else can I help?
L29#5conversations-e2e-fixes-thinking 8.21 You have 42 contacts saved in Thinkspan. How else can I help?
L29#2conversations-e2e-fixes-thinking 11.01 You have 42 contacts. How else can I help?
L29#3conversations-e2e-gateway-thinking 4.81 You have 42 contacts saved in Thinkspan. How else can I help?
L29#1conversations-e2e-gateway-thinking 5.21 You have 42 contacts.
L29#4conversations-e2e-gateway-thinking 7.31 You have 42 contacts. How else can I help?
L29#5conversations-e2e-gateway-thinking 7.31 You have 42 contacts saved in Thinkspan. How else can I help?
L29#2conversations-e2e-gateway-thinking 8.41 You have 42 contacts saved in Thinkspan. How else can I help?
L29#2conversations-e2e-prompt-versions 6.91 You have 42 contacts. How else can I help?
L29#1conversations-e2e-prompt-versions 7.91 You have 42 contacts. How else can I help?
L29#4conversations-e2e-prompt-versions 6.51 You have 42 contacts. How else can I help?
L29#3conversations-e2e-prompt-versions 8.91 You have 42 contacts. How else can I help?
L29#5conversations-e2e-prompt-versions 8.61 You have 42 contacts saved in Thinkspan.
L29#1conversations-staging-deployed-old-build 12.51 You have 42 contacts saved in Thinkspan. How else can I help?
L29#1conversations-staging-deployed 14.91 You have 42 contacts.
L29#2conversations-staging-deployed 16.81 You have 42 contacts. How else can I help?
L29#1conversations-thinking-keep 10.71 You have 42 contacts. How else can I help?
L29#2conversations-thinking-keep 7.91 You have 42 contacts.
L29#3conversations-thinking-keep 8.61 You have 42 contacts. How else can I help?
L29#1conversations-thinking-off 18.22 You have 33 contacts in total.
L29#2conversations-thinking-off 17.62 You have 42 contacts saved in Thinkspan. How else can I help?
L29#3conversations-thinking-off 43.84 You have 20 contacts saved in Thinkspan. How else can I help?
L29#4conversations-thinking-off 9.72 You have 18 contacts saved in Thinkspan.
L29#5conversations-thinking-off 20.73 You have 20 contacts saved in Thinkspan.
L29#1conversations-thoughts-drop 9.41 You have 42 contacts.
L29#2conversations-thoughts-drop 8.81 You have 42 contacts.
L29#3conversations-thoughts-drop 10.41 You have 42 contacts.
L29#4conversations-thoughts-drop 11.91 You have 42 contacts.
L29#5conversations-thoughts-drop 4.31 You have 42 contacts.

Comments

0

Comments are added in the local viewer; this copy is read-only.

Supporting records

The records the answer rests on, from the benchmark's evidence column, with whose they are.

The benchmark names no record ids for this case.