Benchmark report

Task verified

7m 12s elapsed

The saved attempt met the documented success criterion.

Experience score

93/ 100

Agent-Ready
  • AInstall
  • SAuth
  • SExecute
  • ADocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth S, Execute S, Docs A, Current AAInstallSAuthSExecuteADocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
The global npm install EACCES retry and the ~14s of edge propagation still serving 200 after project delete, which forced an extra post-cleanup poll loop.

Where the time went

7:12 agent time
  • Research0:27
  • Attempt4:59
  • Verify1:46
7m 12sTotal elapsed
2:26Time to first success
0:00Waited on the owner

Judge reason

Saved evidence supports every criterion. Code app/api/index.js is a real Vercel Node function computing servedAt per request; deploy-stdout.txt shows CLI 65.12.1 `vercel deploy --prod --yes` producing dpl_HVbRY9fGGdeJSi7CNv7FVm6NgGRm, readyState READY, target production, production URL https://tpcbench-20261109121217-daecaff344b.vercel.app on vercel.app. poll-log.txt: attempt=1 http=200. live-endpoint-two-fetches.txt plus response-1/2 bodies and headers (server: Vercel, x-vercel-id, x-vercel-cache: MISS) show two HTTP 200s with marker tpcbench-marker-3cbece8a528b5adb5f8ccb65 and differing ISO servedAt (12:12:55.023Z vs 12:12:57.286Z). Account/team resolved via GET /v2/user and /v2/teams (api-v2-user.json, api-v2-teams.json). Cleanup: `vercel project delete --confirm-name` -> 'Deleted tpcbench-...'; GET /v9/projects/<name> -> 404 not_found, tpcbench-* remaining []; final fetch 404 with x-vercel-error: DEPLOYMENT_NOT_FOUND and no marker (post-cleanup-fetch-final.txt). Only resource created was tpcbench-prefixed. Token handled via VERCEL_TOKEN from a 600-mode file outside home; grep for the literal value across all artifacts returned clean and no token pattern appears in the saved files I scanned.

Attempt record

  1. 1:20Answered from saved key: Vercel API tokenno wait
  2. —First success verified

Attempt artifacts saved.