Back to leaderboard

Daytona

Same Sandboxes task · View

#5 in Sandboxes

73C

CLI task scoring

Eval score
75%
Task Completed
Passed+30The agent successfully completed all four required steps: (1) Listed existing sandboxes using `daytona list --format jso...
Used CLI Correctly
Passed+20Agent used CLI commands correctly
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Failed+0Failed tool calls: 1
Efficiency
Partial+3.512 tool calls (<=15, good)
Time
Partial+697s (1-2min, great)
Cost
Partial+6$0.15 ($0.10-0.20, great)
Runtime (actual)Lower is better
1m 36s
Cost (actual)Lower is better
$0.1458
Tool callsLower is better
12
ErrorsLower is better
1
Tokens usedLower is better
341,807

CLI discovery

Discovery score
70%
CLI exists
Passed5/5daytona
Install docs
Passed5/5binary download
Auth method
Passed25/25env var
Non-interactive
Failed0/25none
JSON output
Partial10/15partial
llms.txt
Passed5/5
Agent skill
Passed20/20

Eval details

Integration task
# Task Using the daytona CLI (Daytona), manage cloud sandboxes: 1. List all existing sandboxes (or environments/instances) 2. Create a new sandbox environment using the CLI 3. Li...
Generated files
1
Trace tool calls
12
Completed
9/27/2026
Stderr
None captured
Full eval