Back to leaderboard

Compare companies

Side-by-side CLI results for companies evaluated by Codex. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.

Choose 2-4 companies

Selected
Daytona
Stripe
Daytona

Daytona

Sandboxes

Stripe

Stripe

Payment

Summary

Compare status

Comparable
Comparable

Overall score

72
79
Best

Grade

C
B

Category

Sandboxes
Payment

Overall rank

#21
#10
Best

Category rank

#4
#1
Best
CLI Task Scoring

Eval score

74%
Best
74%
Best

Task Completed

Passed+30The agent successfully completed all required steps using the official daytona CLI. Step 1: Listed 6 existing sandboxes...
Best
Passed+30The agent successfully completed all required tasks using the official Stripe CLI. The trace shows: (1) installation of...
Best

Used CLI Correctly

Passed+20Agent used CLI commands correctly
Best
Passed+20Agent used CLI commands correctly
Best

Partial Credit

Passed+10Partial credit: 100%
Best
Passed+10Partial credit: 100%
Best

Zero Errors

Failed+0Failed tool calls: 3
Best
Failed+0Failed tool calls: 2
Best

Efficiency

Partial+2.017 tool calls (<=20, acceptable)
Best
Partial+2.017 tool calls (<=20, acceptable)
Best

Time

Partial+696s (1-2min, great)
Best
Partial+6106s (1-2min, great)
Best

Cost

Partial+6$0.11 ($0.10-0.20, great)
Best
Partial+6$0.11 ($0.10-0.20, great)
Best

Runtime (actual)

1m 36s
Best
1m 46s

Cost (actual)

$0.1129
$0.1091
Best

Tool calls

17
Best
17
Best

Errors

3
2
Best

Tokens used

442,158
427,110
Best
CLI Discovery

Discovery score

70%
93%
Best

CLI exists

Passed5/5daytona
Best
Passed5/5stripe
Best

Install docs

Passed5/5binary download
Best
Passed5/5binary download
Best

Auth method

Passed25/25env var
Best
Passed25/25env var
Best

Non-interactive

Failed0/25none
Partial18/25flag
Best

JSON output

Partial10/15partial
Passed15/15default json
Best

llms.txt

Passed5/5
Best
Passed5/5
Best

Agent skill

Passed20/20
Best
Passed20/20
Best
Eval Details

Integration task

# Task Using the daytona CLI (Daytona), manage cloud sandboxes: 1. List all existing sandboxes (or environments/instances) 2. Create a new sandbox environment using the CLI 3. Li...
# Task Using the stripe CLI (Stripe), create payment resources: 1. Create a product called "Pro Plan" using the CLI 2. Create a price of $29/month (recurring) for that product 3....

Generated files

1
1

Trace tool calls

17
17

Completed

9/27/2026
9/27/2026

Stderr

None captured
None captured