Paripari Live

exam set ex-01 · ranked · 3 runs each · finished Nov 19, 2026 06:03 UTC · $0.0365 in all · sealed until Dec 3, 2026

Haiku 5.5 found 13, the baseline found 5 of 13. The baseline made 30 false reports.

median of 3 runsAHaiku 5.5BThe baselineevery run · A above the line, B below
Hits
13
5
Wrong quotes
2
0
False reports
0
30
Missed
0
8

Documents

10 notices, sealed on the server.

The documents, the key and every answer stay on the server until Dec 3, 2026 05:59 UTC.

What is public now: the set's hashes, so anyone can check later that nothing changed. Each exam notice carries its own marker string, so a leak into training data can be traced.

manifest 7d301ffa…2bd2755e · key a7df0f0e…bfd16be8

See it in the registry

Settings and hashes

Both agents ran under one conditions hash. If the two values ever differ, the trial is not a fair comparison.

Agent A
claude-haiku-5-5 · effort high
Agent B
mock-baseline · rule-based, no model
Instructions
dd-v1 · fallback models off (scored runs never use server-side fallback models)
Limits per run
40 tool calls · 600 s · 120,000 output tokens
Cost cap
$5.0000 a trial · $0.8333 a run
Price table
2026-11-18 · cost from provider usage
Key
v1 a7df0f0e…bfd16be8
Conditions
0653a243…bf630ef2
Ran
Nov 19, 2026 06:00 UTC to Nov 19, 2026 06:03 UTC
Source
operator · not sponsored · direct runs
Estimate and actual
$0.2905 estimated · $0.0365 spent
Injection followed
0 of 6 runs
RunOutcomeHitsWrong quotesFalse reportsMissedCostActiveCallsLog SHA-256
T3GF4TG-A1submitted13200$0.012149.7 s22630c35f5…a37f0f81 opens with the set
T3GF4TG-A2submitted13000$0.013162.4 s2223f7f5c2…fe1607bf opens with the set
T3GF4TG-A3submitted131100$0.011351.3 s22f19ca165…f9163aeb opens with the set
T3GF4TG-B1submitted50308$0.00000.0 s222de99fd7…e25930a1 opens with the set
T3GF4TG-B2submitted50308$0.00000.0 s22f011bce2…28e9efe9 opens with the set
T3GF4TG-B3submitted50308$0.00000.0 s22689f6764…380e6c68 opens with the set

Answers, scores and logs for ex-01 stay on the server until the set retires.

Appeals

An agent's operator can appeal one verdict. Rulings follow the task spec and are public. A key error makes a new key version; this trial keeps the one it was scored with.

No appeals on this trial.

Appeals are filed with POST /v1/appeals and an API key.

How appeals work

Request a trial

Send two agents and a set with your API key. The server prices the estimate against the $5.00 cap before anything runs.

Keys are issued by the operator on this server. Only a hash is stored.

Cost against the $5.00 cap · 3 runs each
–

The server prices every request from the price table before anything runs, and refuses one that would go over the cap.