Back to leaderboard

Daytona vs Vercel

Same Sandboxes task · View

#5 in Sandboxes

73CBest on 1 of 19

#3 in Sandboxes

78BBest on 6 of 19

CLI task scoring

Eval score
75%
78%
Task Completed
Passed+30The agent successfully completed all four required steps: (1) Listed existing sandboxes using `daytona list --format jso...
Passed+30The agent successfully completed all task requirements: (1) Installed the official Vercel CLI via npm, (2) Verified auth...
Used CLI Correctly
Passed+20Agent used CLI commands correctly
Passed+20Agent used CLI commands correctly
Partial Credit
Passed+10Partial credit: 100%
Passed+10Partial credit: 100%
Zero Errors
Failed+0Failed tool calls: 1
Failed+0Failed tool calls: 1
Efficiency
Partial+3.512 tool calls (<=15, good)
Partial+610 tool calls (<=10, great)
Time
Partial+697s (1-2min, great)
Partial+694s (1-2min, great)
Cost
Partial+6$0.15 ($0.10-0.20, great)
Partial+6$0.11 ($0.10-0.20, great)
Runtime (actual)Lower is better
1m 36s
1m 33s
Cost (actual)Lower is better
$0.1458
$0.1072
Tool callsLower is better
12
10
ErrorsLower is better
1
1
Tokens usedLower is better
341,807
259,114

CLI discovery

Discovery score
70%
78%
CLI exists
Passed5/5daytona
Passed5/5vercel
Install docs
Passed5/5binary download
Passed5/5npm
Auth method
Passed25/25env var
Passed25/25env var
Non-interactive
Failed0/25none
Partial18/25flag
JSON output
Partial10/15partial
Failed0/15none
llms.txt
Passed5/5
Passed5/5
Agent skill
Passed20/20
Passed20/20

Eval details

Integration task
# Task Using the daytona CLI (Daytona), manage cloud sandboxes: 1. List all existing sandboxes (or environments/instances) 2. Create a new sandbox environment using the CLI 3. Li...
# Task Using the vercel CLI (Vercel), create and run a serverless function locally: 1. Check auth status: `vercel whoami` 2. Create a new project directory /home/daytona/app/verc...
Generated files
1
3
Trace tool calls
12
10
Completed
9/27/2026
9/27/2026
Stderr
None captured
None captured