Benchmark report

Task verified

6m 53s elapsed

The saved attempt met the documented success criterion.

Experience score

100/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current SSInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Minor self-inflicted friction: one revoke attempt failed because ADMIN_URI was unset in a new shell, and ssl_is_used() did not exist so TLS proof came from conninfo.

Where the time went

6:53 agent time
  • Research0:24
  • Attempt4:23
  • Verify2:06
6m 53sTotal elapsed
2:31Time to first success
0:00Waited on the owner

Judge reason

Saved artifacts show the full chain executed live against Supabase. Management API (Bearer PAT) returned HTTP 200 GET /v1/organizations, HTTP 201 POST /v1/projects creating tpcbench-hscfvwcs (ref wnkpwjbnqaartutahrnm), and the pooler config (out/04). The scoped credential was made by the documented SQL path (CREATE ROLE ro_items_hscfvwcs WITH LOGIN PASSWORD + GRANT USAGE/SELECT, citing supabase.com/docs/guides/database/postgres/roles): out/06 shows CREATE ROLE/GRANT and only SELECT on public.items. Connecting with only that role over aws-1-us-east-1.pooler.supabase.com:5432 with sslmode=require (out/07; out/09 'SSL connection (protocol: TLSv1.3, cipher TLS_AES_256_GCM_SHA384)') gives current_user=ro_items_hscfvwcs, SELECT returns 3 rows, INSERT fails 'permission denied for table items' (out/08). Revocation via REVOKE/DROP ROLE with follow-up read role_rows_remaining=0 (out/10), and a reconnect with it then fails FATAL (EAUTHQUERY) user not found, psql exit 2 (out/11). Project deleted HTTP 200 (out/12) with follow-up GET 404 'Resource has been removed' and an empty project list (out/13). A secret scan found 0 files containing any secret value; the only user:pass@ URIs in saved files are Supabase doc placeholders ([YOUR-PASSWORD]). Nothing was mocked or hard-coded; work/code reproduces the run.

Attempt record

  1. 0:39Answered from saved key: SUPABASE_ACCESS_TOKENno wait
  2. —First success verified

Attempt artifacts saved.