Benchmark report

Task verified

3m 51s elapsed

The saved attempt met the documented success criterion.

Experience score

100/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current SSInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Essentially nothing: a single discovery call for org/group preceded one clean scripted run; first success was recorded at 84s.

Where the time went

3:51 agent time
  • Research0:21
  • Attempt2:21
  • Verify1:09
3m 51sTotal elapsed
1:24Time to first success
0:00Waited on the owner

Judge reason

Saved code (work/turso_task.py) ran live against api.turso.tech: 01-create-database.response.json shows HTTP 200 creating tpcbench-54477d34 (org rickchen, group default), a db auth token was minted, and SQL ran over the HTTPS Hrana v2 endpoint https://tpcbench-54477d34-rickchen.aws-ap-northeast-1.turso.io/v2/pipeline. 03-create-table shows CREATE TABLE items (id INTEGER PRIMARY KEY, name TEXT) HTTP 200; 04-insert-rows.request.json uses 'INSERT INTO items (id, name) VALUES (?, ?)' with typed bound args for (1,alpha),(2,beta),(3,gamma), response affected_row_count=1 each; 05-select-rows uses named arg :min_id=2 with ORDER BY id and returns exactly rows (2,beta),(3,gamma), matching the printed '(2, beta)/(3, gamma)' in phase1-full-output.txt and the transcript tool output. No string concatenation; no mocks. Cleanup: DELETE returned HTTP 200 {"database":"tpcbench-54477d34"}, follow-up GET returned HTTP 404 record not found, and the list-databases response (16 KB, 0 occurrences of tpcbench) confirms absence. TLS is evidenced by the https scheme in connection-parameters.txt plus successful 200s; the API token was read only from the benchmark secret file and the minted JWT is <REDACTED> in 02-mint-db-token.response.json (leak grep: 0 hits in agent artifacts).

Attempt record

  1. 0:36Answered from saved key: TURSO_API_TOKENno wait
  2. —First success verified

Attempt artifacts saved.