Benchmark report

Task verified

4m 21s elapsed

The saved attempt met the documented success criterion.

Experience score

96/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current SSInstallSAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Two HTTP 400 'org_id is required' responses: the org-scoped key needed an org lookup and org_id nested inside the project body, costing one extra call and one script edit.

Where the time went

4:22 agent time
  • Starting0:01
  • Research0:28
  • Attempt2:19
  • Verify1:34
4m 21sTotal elapsed
1:36Time to first success
0:00Waited on the owner

Judge reason

Saved bash script work/neon_provision.sh ran the full cycle against the real Neon management API (https://console.neon.tech/api/v2). POST /projects -> HTTP 201 created project lively-rain-68795580 (tpcbench-1793909827-706bc52ce609) in aws-us-east-2, pg 17; readiness polled via GET /projects/{id}/operations until 0 non-finished, GET /projects/{id} -> 200. Stock psql connected with sslmode=verify-full&sslrootcert=system (saved in 05_connection_params.txt) and 06_select1.txt shows select_one=1, PostgreSQL 17.11, psql exit 0; pg_stat_ssl ssl=f is explicitly allowed behind the Neon proxy. DELETE /projects/lively-rain-68795580 -> HTTP 200 with full project body (07), follow-up GET -> HTTP 404 'project not found' (08), and the 68KB list after delete (09) has 46 projects with zero matching id or name. grep over all saved artifacts finds no plaintext password and no password-bearing URI: connection_uri and password fields are [REDACTED] and only the redacted URI shape appears. Responses carry real request_ids, operation ids and timestamps; nothing is mocked.

Attempt record

  1. 0:42Answered from saved key: NEON_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.