Compare companies

Side-by-side API results for companies evaluated by Pi. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.

Model

Claude Code Codex

Codex

Tooling

API CLI MCP

Choose 2-4 companies

Selected

Company 1

Company 2

Showing the first two companies on mobile. Use a wider screen to compare 3 companies.

Selected

Company 1

Company 2

Company 3

Mobile compare is limited to two companies. Use a wider screen to compare all 3.

Postman

API Testing

Stripe

Payment

Summary

Compare status

Comparable

Overall score

Best

Grade

Category

API Testing

Payment

Overall rank

Best

Category rank

Best

Full eval

Open report

Agent Performance

Eval score

90%

Best

90%

Best

Task success

Yes

Cost

$0.0007

Best

$0.0008

Tool calls

Best

Errors

Best

Runtime

41s

38s

Best

Tokens used

76,407

53,043

Best

Exit code

Best

Discoverability

Discovery score

100%

Best

100%

Best

Context7

llms.txt

MCP Server

Typed SDK

OpenAPI

Agent Skills

CLI

Eval Details

Integration task

# Task Using https://learning.postman.com/docs/reference/postman-api/intro-api, complete the following task: Using the Postman API, build me a script that runs a small API collec...

# Task Using https://docs.stripe.com, complete the following task: Using Stripe, build me a payment link for a $29/month "Pro Plan" subscription and print the URL The script sho...

Generated files

Trace tool calls

Completed

10/20/2026

Stderr

None captured

Metric	Postman API Testing	Stripe Payment	Fireworks AI Inference
Summary
Compare status	Comparable	Comparable	Comparable
Overall score	93 Best	93 Best	93 Best
Grade	A	A	A
Category	API Testing	Payment	Inference
Overall rank	#1 Best	#1 Best	#1 Best
Category rank	#1 Best	#1 Best	#1 Best
Full eval	Open report	Open report	Open report
Agent Performance
Eval score	90% Best	90% Best	90% Best
Task success	Yes	Yes	Yes
Cost	$0.0007	$0.0008	$0.0006 Best
Tool calls	9	8 Best	8 Best
Errors	0 Best	0 Best	0 Best
Runtime	41s	38s	36s Best
Tokens used	76,407	53,043	35,072 Best
Exit code	0 Best	0 Best	0 Best
Discoverability
Discovery score	100% Best	100% Best	100% Best
Context7	Yes	Yes	Yes
llms.txt	Yes	Yes	Yes
MCP Server	Yes	Yes	Yes
Typed SDK	Yes	Yes	Yes
OpenAPI	Yes	Yes	Yes
Agent Skills	Yes	Yes	Yes
CLI	Yes	Yes	Yes
Eval Details
Integration task	# Task Using https://learning.postman.com/docs/reference/postman-api/intro-api, complete the following task: Using the Postman API, build me a script that runs a small API collec...	# Task Using https://docs.stripe.com, complete the following task: Using Stripe, build me a payment link for a $29/month "Pro Plan" subscription and print the URL The script sho...	# Task Using https://docs.fireworks.ai, complete the following task: Using Fireworks AI, build me a script that extracts structured data from this invoice and returns JSON: ---...
Generated files	1	1	1
Trace tool calls	9	8	8
Completed	10/20/2026	10/20/2026	10/20/2026
Stderr	None captured	None captured	None captured