Compare companies

Side-by-side API results for companies evaluated by Claude Code. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.

Model

Claude Code Codex

Codex

Tooling

API CLI MCP

Choose 2-4 companies

Selected

Company 1

Company 2

Selected

Company 1

Company 2

Stripe

Payment

Fireworks AI

Inference

Summary

Compare status

Comparable

Overall score

Best

Grade

Category

Payment

Inference

Overall rank

Best

#23

Category rank

Best

Full eval

Open report

Agent Performance

Eval score

91%

Best

76%

Task success

Yes

Cost

$0.0762

Best

$0.2194

Tool calls

Best

Errors

Best

Runtime

36s

Best

1m 12s

Tokens used

149,877

Best

248,256

Exit code

Best

Discoverability

Discovery score

86%

Best

86%

Best

Context7

Yes

Best

llms.txt

MCP Server

Typed SDK

OpenAPI

Best

Agent Skills

Yes

CLI

Yes

Eval Details

Integration task

# Task Using https://docs.stripe.com, complete the following task: Using Stripe, build me a payment link for a $29/month "Pro Plan" subscription and print the URL The script sho...

# Task Using https://docs.fireworks.ai, complete the following task: Using Fireworks AI, build me a script that extracts structured data from this invoice and returns JSON: ---...

Generated files

Trace tool calls

Completed

9/23/2026

Stderr

None captured

Metric	Stripe Payment	Fireworks AI Inference
Summary
Compare status	Comparable	Comparable
Overall score	89 Best	79
Grade	B	B
Category	Payment	Inference
Overall rank	#3 Best	#23
Category rank	#1 Best	#2
Full eval	Open report	Open report
Agent Performance
Eval score	91% Best	76%
Task success	Yes	Yes
Cost	$0.0762 Best	$0.2194
Tool calls	6 Best	11
Errors	2	1 Best
Runtime	36s Best	1m 12s
Tokens used	149,877 Best	248,256
Exit code	0 Best	0 Best
Discoverability
Discovery score	86% Best	86% Best
Context7	Yes Best	No
llms.txt	Yes	Yes
MCP Server	Yes	Yes
Typed SDK	Yes	Yes
OpenAPI	No	Yes Best
Agent Skills	Yes	Yes
CLI	Yes	Yes
Eval Details
Integration task	# Task Using https://docs.stripe.com, complete the following task: Using Stripe, build me a payment link for a $29/month "Pro Plan" subscription and print the URL The script sho...	# Task Using https://docs.fireworks.ai, complete the following task: Using Fireworks AI, build me a script that extracts structured data from this invoice and returns JSON: ---...
Generated files	1	1
Trace tool calls	6	11
Completed	9/23/2026	9/23/2026
Stderr	None captured	None captured