Back to leaderboard

Stripe

Same Payment task · View

#1 in Payment

80B

CLI task scoring

Eval score
75%
Task Completed
Passed+30The agent successfully completed all required steps using the official Stripe CLI. Step [4] installed the stripe CLI via...
Used CLI Correctly
Passed+20Agent used CLI commands correctly
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Failed+0Failed tool calls: 1
Efficiency
Partial+3.511 tool calls (<=15, good)
Time
Partial+683s (1-2min, great)
Cost
Partial+6$0.17 ($0.10-0.20, great)
Runtime (actual)Lower is better
1m 23s
Cost (actual)Lower is better
$0.1656
Tool callsLower is better
11
ErrorsLower is better
1
Tokens usedLower is better
293,058

CLI discovery

Discovery score
93%
CLI exists
Passed5/5stripe
Install docs
Passed5/5binary download
Auth method
Passed25/25env var
Non-interactive
Partial18/25flag
JSON output
Passed15/15default json
llms.txt
Passed5/5
Agent skill
Passed20/20

Eval details

Integration task
# Task Using the stripe CLI (Stripe), create payment resources: 1. Create a product called "Pro Plan" using the CLI 2. Create a price of $29/month (recurring) for that product 3....
Generated files
1
Trace tool calls
11
Completed
9/27/2026
Stderr
None captured
Full eval