Benchmark report

Task verified

5m 3s elapsed

The saved attempt met the documented success criterion.

Experience score

96/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current SSInstallSAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Sender-signature discovery: the provided server token got 401 ErrorCode 10 on account-level /senders and /domains, forcing a fallback to /messages/outbound.

Where the time went

5:04 agent time
  • Research0:18
  • Attempt3:01
  • Verify1:43
5m 3sTotal elapsed
1:32Time to first success
0:00Waited on the owner

Judge reason

send_email.py POSTs to the documented https://api.postmarkapp.com/email with the X-Postmark-Server-Token header; evidence/request.json matches the code byte-for-byte (From 'Rick chen <rick@promptingco.com>', To test@blackhole.postmarkapp.com -- Postmark's documented blackhole test recipient, Subject 'Postmark transactional send test 2026-11-09', plain-text TextBody, MessageStream outbound). Transcript line 51-52 shows the live run printing 'HTTP status: 200' and MessageID 69ab779f-127a-4a2d-ac44-b6dfce5b85a6, identical to evidence/send_response.json (ErrorCode 0, Message 'OK', SubmittedAt 2026-11-09T19:35:34.8904953Z) and to send_stdout.txt, with live Postmark response headers (X-Postmark-Server 19755949, Ratelimit-Remaining 4999). The sender was discovered through the API before the send: transcript line 43-44 shows GET /messages/outbound returning 200 with prior Status 'Sent' messages From "Rick chen" <rick@promptingco.com> (GET /senders and /domains returned 401 ErrorCode 10, needing an account-level token). An independent read-back, GET /messages/outbound/{id}/details, returned 200 with Status 'Sent', Recipients [test@blackhole.postmarkapp.com] and the matching MIME body. No SDK was needed (single REST call via Python stdlib); no inbox was created, so no deletion applies; nothing mocked or hard-coded.

Attempt record

  1. 1:00Answered from saved key: Postmark Server API Tokenno wait
  2. —First success verified

Attempt artifacts saved.