Compare companies

Side-by-side API results for companies evaluated by Codex. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.

Model

Claude Code Codex

Codex

Tooling

API CLI MCP

Choose 2-4 companies

Selected

Company 1

Company 2

Showing the first two companies on mobile. Use a wider screen to compare 3 companies.

Selected

Company 1

Company 2

Company 3

Mobile compare is limited to two companies. Use a wider screen to compare all 3.

OpenRouter

Inference

Daytona

Sandboxes

Summary

Compare status

Comparable

Overall score

Best

Grade

Category

Inference

Sandboxes

Overall rank

#20

Best

Category rank

Best

Full eval

Open report

Agent Performance

Eval score

76%

79%

Best

Task success

Yes

Cost

$0.1847

Best

$0.2038

Tool calls

Best

Errors

Best

Runtime

1m 7s

44s

Best

Tokens used

607,456

Best

683,652

Exit code

Best

Discoverability

Discovery score

86%

100%

Best

Context7

llms.txt

MCP Server

Typed SDK

OpenAPI

Agent Skills

CLI

Best

Eval Details

Integration task

# Task Using https://openrouter.ai/docs, complete the following task: Using OpenRouter, build me a script that extracts structured data from this invoice and returns JSON: --- I...

# Task Using https://www.daytona.io/docs/en/python-sdk/, complete the following task: Using Daytona, build me a script that runs a multi-step computation inside a Daytona sandbox...

Generated files

Trace tool calls

Completed

9/27/2026

9/26/2026

Stderr

None captured

Metric	OpenRouter Inference	Daytona Sandboxes	Stripe Payment
Summary
Compare status	Comparable	Comparable	Comparable
Overall score	79	85 Best	76
Grade	B	B	B
Category	Inference	Sandboxes	Payment
Overall rank	#20	#5 Best	#29
Category rank	#2	#3	#1 Best
Full eval	Open report	Open report	Open report
Agent Performance
Eval score	76%	79% Best	72%
Task success	Yes	Yes	Yes
Cost	$0.1847 Best	$0.2038	$0.3000
Tool calls	25	23 Best	26
Errors	4	6	1 Best
Runtime	1m 7s	44s Best	1m 2s
Tokens used	607,456	683,652	238,000 Best
Exit code	0 Best	0 Best	0 Best
Discoverability
Discovery score	86%	100% Best	86%
Context7	Yes	Yes	Yes
llms.txt	Yes	Yes	Yes
MCP Server	Yes	Yes	Yes
Typed SDK	Yes	Yes	Yes
OpenAPI	Yes Best	Yes Best	No
Agent Skills	Yes	Yes	Yes
CLI	No	Yes Best	Yes Best
Eval Details
Integration task	# Task Using https://openrouter.ai/docs, complete the following task: Using OpenRouter, build me a script that extracts structured data from this invoice and returns JSON: --- I...	# Task Using https://www.daytona.io/docs/en/python-sdk/, complete the following task: Using Daytona, build me a script that runs a multi-step computation inside a Daytona sandbox...	# Task Using https://docs.stripe.com, complete the following task: Using Stripe, build me a payment link for a $29/month "Pro Plan" subscription and print the URL The script sho...
Generated files	1	1	2
Trace tool calls	25	23	26
Completed	9/27/2026	9/26/2026	9/27/2026
Stderr	None captured	None captured	None captured