Stripe
All 1 ran the same Payment task · Same Payment task · View the taskView the task
CompanyClick a name to swap it
#1 in Payment · #9 overall
80B
Compare up to 4.
CLI task scoring
Eval score
75%
Task Completed
Passed+30The agent successfully completed all required steps using the official Stripe CLI. Step [4] installed the stripe CLI via...
Used CLI Correctly
Passed+20Agent used CLI commands correctly
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Failed+0Failed tool calls: 1
Efficiency
Partial+3.511 tool calls (<=15, good)
Time
Partial+683s (1-2min, great)
Cost
Partial+6$0.17 ($0.10-0.20, great)
Runtime (actual)Lower is better
1m 23s
Cost (actual)Lower is better
$0.1656
Tool callsLower is better
11
ErrorsLower is better
1
Tokens usedLower is better
293,058
CLI discovery
Discovery score
93%
CLI exists
Passed5/5stripe
Install docs
Passed5/5binary download
Auth method
Passed25/25env var
Non-interactive
Partial18/25flag
JSON output
Passed15/15default json
llms.txt
Passed5/5
Agent skill
Passed20/20
Eval details
Integration task
# Task
Using the stripe CLI (Stripe), create payment resources:
1. Create a product called "Pro Plan" using the CLI
2. Create a price of $29/month (recurring) for that product
3....
Generated files
1
Trace tool calls
11
Completed
9/27/2026
Stderr
None captured
Full eval
#1 in Payment
80B
CLI task scoring
Eval score
75%
Task Completed
Passed+30The agent successfully completed all required steps using the official Stripe CLI. Step [4] installed the stripe CLI via...
Used CLI Correctly
Passed+20Agent used CLI commands correctly
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Failed+0Failed tool calls: 1
Efficiency
Partial+3.511 tool calls (<=15, good)
Time
Partial+683s (1-2min, great)
Cost
Partial+6$0.17 ($0.10-0.20, great)
Runtime (actual)Lower is better
1m 23s
Cost (actual)Lower is better
$0.1656
Tool callsLower is better
11
ErrorsLower is better
1
Tokens usedLower is better
293,058
CLI discovery
Discovery score
93%
CLI exists
Passed5/5stripe
Install docs
Passed5/5binary download
Auth method
Passed25/25env var
Non-interactive
Partial18/25flag
JSON output
Passed15/15default json
llms.txt
Passed5/5
Agent skill
Passed20/20
Eval details
Integration task
# Task
Using the stripe CLI (Stripe), create payment resources:
1. Create a product called "Pro Plan" using the CLI
2. Create a price of $29/month (recurring) for that product
3....
Generated files
1
Trace tool calls
11
Completed
9/27/2026
Stderr
None captured
Full eval