Stripe
All 1 ran the same Payment task · Same Payment task · View the taskView the task
CompanyClick a name to swap it
#2 in Payment · #16 overall
83B
Compare up to 4. Next in Payment:
MCP task scoring
Task score
83%
Task
Passed+30The agent successfully completed all required tasks using only MCP tools. It: (1) discovered available MCP tools and the...
Used MCP Correctly
Passed+20Agent made 10 MCP tool calls
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Passed+10No errors
Efficiency
Partial+3.512 tool calls (<=15, good)
Time
Partial+3.5137s (2-3min, good)
Cost
Partial+6$0.17 ($0.10-0.20, great)
Runtime (actual)Lower is better
2m 17s
Cost (actual)Lower is better
$0.1663
Tool callsLower is better
12
ErrorsLower is better
0
Tokens usedLower is better
300,154
MCP discovery
Discovery score
86%
Official MCP
Passed5/5
Auth Method
Passed15/15env var
Tool Count
Passed10/109 tools, lean
Tool Description Length
Partial7/103,797 tokens, moderate
llms.txt
Passed10/10
Output Schema
Failed0/5
Tool Stability
Passed5/5
Security Posture
Partial9/10No API keys or tokens visible in descriptions or schemas; parameters are well-typed with enums where appropriate; stripe...
Tool API Mapping
Partial12/15Most tools map 1:1 to API operations (stripe_api_search, stripe_api_read, stripe_api_write, stripe_api_details), but str...
Description Clarity
Partial13/15Tool descriptions are generally clear with explicit guidance on when to use each tool (e.g., stripe_implementation_plann...
Eval details
Integration task
# Task
Using the Stripe MCP, create payment resources:
1. Discover available MCP tools and their capabilities
2. Create a product called "Pro Plan" using the MCP tools
3. Create...
Generated files
1
Trace tool calls
12
Completed
9/27/2026
Stderr
None captured
Full eval
#2 in Payment
83B
MCP task scoring
Task score
83%
Task
Passed+30The agent successfully completed all required tasks using only MCP tools. It: (1) discovered available MCP tools and the...
Used MCP Correctly
Passed+20Agent made 10 MCP tool calls
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Passed+10No errors
Efficiency
Partial+3.512 tool calls (<=15, good)
Time
Partial+3.5137s (2-3min, good)
Cost
Partial+6$0.17 ($0.10-0.20, great)
Runtime (actual)Lower is better
2m 17s
Cost (actual)Lower is better
$0.1663
Tool callsLower is better
12
ErrorsLower is better
0
Tokens usedLower is better
300,154
MCP discovery
Discovery score
86%
Official MCP
Passed5/5
Auth Method
Passed15/15env var
Tool Count
Passed10/109 tools, lean
Tool Description Length
Partial7/103,797 tokens, moderate
llms.txt
Passed10/10
Output Schema
Failed0/5
Tool Stability
Passed5/5
Security Posture
Partial9/10No API keys or tokens visible in descriptions or schemas; parameters are well-typed with enums where appropriate; stripe...
Tool API Mapping
Partial12/15Most tools map 1:1 to API operations (stripe_api_search, stripe_api_read, stripe_api_write, stripe_api_details), but str...
Description Clarity
Partial13/15Tool descriptions are generally clear with explicit guidance on when to use each tool (e.g., stripe_implementation_plann...
Eval details
Integration task
# Task
Using the Stripe MCP, create payment resources:
1. Discover available MCP tools and their capabilities
2. Create a product called "Pro Plan" using the MCP tools
3. Create...
Generated files
1
Trace tool calls
12
Completed
9/27/2026
Stderr
None captured
Full eval