Back to leaderboard

Render

Same Cloud Hosting task · View

#2 in Cloud Hosting

74C

CLI task scoring

Eval score
63%
Task Completed
Passed+30The agent successfully completed all required task steps: (1) cloned the nextjs-starter repository from GitHub, (2) used...
Used CLI Correctly
Passed+20Agent used CLI commands correctly
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Failed+0Failed tool calls: 7
Efficiency
Failed+030 tool calls (>25, inefficient)
Time
Partial+1.0312s (5-10min, very slow)
Cost
Partial+2.0$0.49 ($0.40-0.70, expensive)
Runtime (actual)Lower is better
5m 11s
Cost (actual)Lower is better
$0.4943
Tool callsLower is better
30
ErrorsLower is better
7
Tokens usedLower is better
1,280,145

CLI discovery

Discovery score
100%
CLI exists
Passed5/5render
Install docs
Passed5/5install script
Auth method
Passed25/25env var
Non-interactive
Passed25/25auto detect
JSON output
Passed15/15full
llms.txt
Passed5/5
Agent skill
Passed20/20

Eval details

Integration task
# Task Using the render CLI (Render), deploy this application https://github.com/[REDACTED:NAME]/nextjs-starter to Render: 1. Clone the repository: `git clone https://github.com/...
Generated files
1
Trace tool calls
30
Completed
9/27/2026
Stderr
None captured
Full eval