Compare companies

Side-by-side API results for companies evaluated by Claude Code. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.

Model

Claude Code Codex

Codex

Tooling

API CLI MCP

Choose 2-4 companies

Selected

Company 1

Company 2

Showing the first two companies on mobile. Use a wider screen to compare 3 companies.

Selected

Company 1

Company 2

Company 3

Mobile compare is limited to two companies. Use a wider screen to compare all 3.

Deepgram

Voice STT

OpenRouter

Inference

Summary

Compare status

Comparable

Overall score

Best

Grade

Category

Voice STT

Inference

Overall rank

Best

Category rank

Best

Full eval

Open report

Agent Performance

Eval score

81%

92%

Best

Task success

Yes

Cost

$0.1728

$0.1176

Best

Tool calls

Best

Errors

Best

Runtime

1m 0s

58s

Best

Tokens used

192,334

120,238

Best

Exit code

Best

Discoverability

Discovery score

100%

Best

86%

Context7

Yes

llms.txt

Yes

MCP Server

Yes

Best

Typed SDK

OpenAPI

Agent Skills

CLI

Eval Details

Integration task

# Task Using https://developers.deepgram.com/docs, complete the following task: Using the Deepgram Python SDK, build me a script that transcribes a sample audio file: 1. Install...

# Task Using https://openrouter.ai/docs, complete the following task: Using OpenRouter, build me a script that extracts structured data from this invoice and returns JSON: --- I...

Generated files

Trace tool calls

Completed

9/26/2026

9/23/2026

Stderr

None captured

Metric	Deepgram Voice STT	OpenRouter Inference	Fireworks AI Inference
Summary
Compare status	Comparable	Comparable	Comparable
Overall score	86	90 Best	79
Grade	B	A	B
Category	Voice STT	Inference	Inference
Overall rank	#5	#1 Best	#23
Category rank	#1 Best	#1 Best	#2
Full eval	Open report	Open report	Open report
Agent Performance
Eval score	81%	92% Best	76%
Task success	Yes	Yes	Yes
Cost	$0.1728	$0.1176 Best	$0.2194
Tool calls	8	6 Best	11
Errors	1	0 Best	1
Runtime	1m 0s	58s Best	1m 12s
Tokens used	192,334	120,238 Best	248,256
Exit code	0 Best	0 Best	0 Best
Discoverability
Discovery score	100% Best	86%	86%
Context7	Yes Best	Yes Best	No
llms.txt	Yes	Yes	Yes
MCP Server	Yes Best	No	Yes Best
Typed SDK	Yes	Yes	Yes
OpenAPI	Yes	Yes	Yes
Agent Skills	Yes	Yes	Yes
CLI	Yes	Yes	Yes
Eval Details
Integration task	# Task Using https://developers.deepgram.com/docs, complete the following task: Using the Deepgram Python SDK, build me a script that transcribes a sample audio file: 1. Install...	# Task Using https://openrouter.ai/docs, complete the following task: Using OpenRouter, build me a script that extracts structured data from this invoice and returns JSON: --- I...	# Task Using https://docs.fireworks.ai, complete the following task: Using Fireworks AI, build me a script that extracts structured data from this invoice and returns JSON: ---...
Generated files	1	1	1
Trace tool calls	8	6	11
Completed	9/26/2026	9/23/2026	9/23/2026
Stderr	None captured	None captured	None captured