Back to leaderboard

Daytona

Same Sandboxes task · View

#2 in Sandboxes

47D

MCP task scoring

Task score
30%
Task
Failed+0The agent correctly used MCP tools for sandbox operations and successfully created a new sandbox (step 3). However, it f...
Used MCP Correctly
Passed+20Agent made 16 MCP tool calls
Partial Credit
Partial+6Partial credit: 60%
Zero Errors
Failed+0Failed tool calls: 6
Efficiency
Failed+027 tool calls (>25, inefficient)
Time
Partial+1.0329s (5-10min, very slow)
Cost
Partial+3.5$0.37 ($0.20-0.40, good)
Runtime (actual)Lower is better
5m 28s
Cost (actual)Lower is better
$0.3691
Tool callsLower is better
27
ErrorsLower is better
6
Tokens usedLower is better
873,418

MCP discovery

Discovery score
87%
Official MCP
Passed5/5
Auth Method
Passed15/15env var
Tool Count
Passed10/1012 tools, lean
Tool Description Length
Partial7/102,341 tokens, moderate
llms.txt
Passed10/10
Output Schema
Failed0/5
Tool Stability
Passed5/5
Security Posture
Partial8/10No API keys or tokens visible in descriptions or schemas; parameters are clearly typed and input validation is present (...
Tool API Mapping
Partial14/15Tools map cleanly 1:1 to individual sandbox operations (create, destroy, execute, file operations, git operations, previ...
Description Clarity
Partial13/15Tool descriptions are clear and specific about their purpose; most explain what they do and expected inputs/outputs, tho...

Eval details

Integration task
# Task Using the Daytona MCP, manage cloud sandboxes: 1. Discover available MCP tools and their capabilities 2. List all existing sandboxes (or environments/workers/deployments)...
Generated files
1
Trace tool calls
27
Completed
9/27/2026
Stderr
None captured
Full eval