Compare companies

Side-by-side API results for companies evaluated by Codex. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.

Model

Claude Code Codex

Codex

Tooling

API CLI MCP

Choose 2-4 companies

Selected

Company 1

Company 2

Showing the first two companies on mobile. Use a wider screen to compare 3 companies.

Selected

Company 1

Company 2

Company 3

Mobile compare is limited to two companies. Use a wider screen to compare all 3.

Deepgram

Voice STT

Agentmail

Summary

Compare status

Comparable

Overall score

Best

Grade

Category

Voice STT

Overall rank

Best

#58

Category rank

Best

Full eval

Open report

Agent Performance

Eval score

80%

Best

66%

Task success

Yes

Cost

$0.2314

Best

$0.3199

Tool calls

Best

Errors

Best

Runtime

46s

Best

4m 4s

Tokens used

307,782

Best

845,823

Exit code

Best

Discoverability

Discovery score

100%

Best

86%

Context7

Yes

Best

llms.txt

MCP Server

Typed SDK

OpenAPI

Agent Skills

CLI

Eval Details

Integration task

# Task Using https://developers.deepgram.com/docs, complete the following task: Using the Deepgram Python SDK, build me a script that transcribes a sample audio file: 1. Install...

# Task Using https://docs.agentmail.to, complete the following task: Using Agentmail, build me a script that: 1. Create a new email inbox 2. Send an email from that inbox to "su...

Generated files

Trace tool calls

Completed

9/27/2026

10/15/2026

Stderr

None captured

Metric	Deepgram Voice STT	Agentmail Email	Resend Email
Summary
Compare status	Comparable	Comparable	Comparable
Overall score	86 Best	72	76
Grade	B	C	B
Category	Voice STT	Email	Email
Overall rank	#3 Best	#58	#29
Category rank	#1 Best	#2	#1 Best
Full eval	Open report	Open report	Open report
Agent Performance
Eval score	80% Best	66%	72%
Task success	Yes	Yes	Yes
Cost	$0.2314 Best	$0.3199	$0.3754
Tool calls	16 Best	30	27
Errors	1 Best	3	7
Runtime	46s Best	4m 4s	1m 42s
Tokens used	307,782 Best	845,823	868,719
Exit code	0 Best	0 Best	0 Best
Discoverability
Discovery score	100% Best	86%	86%
Context7	Yes Best	No	No
llms.txt	Yes	Yes	Yes
MCP Server	Yes	Yes	Yes
Typed SDK	Yes	Yes	Yes
OpenAPI	Yes	Yes	Yes
Agent Skills	Yes	Yes	Yes
CLI	Yes	Yes	Yes
Eval Details
Integration task	# Task Using https://developers.deepgram.com/docs, complete the following task: Using the Deepgram Python SDK, build me a script that transcribes a sample audio file: 1. Install...	# Task Using https://docs.agentmail.to, complete the following task: Using Agentmail, build me a script that: 1. Create a new email inbox 2. Send an email from that inbox to "su...	# Task Using https://resend.com/docs, complete the following task: Using Resend, build me a script that: 1. Create a new email inbox 2. Send an email from that inbox to "support...
Generated files	1	2	1
Trace tool calls	16	30	27
Completed	9/27/2026	10/15/2026	9/30/2026
Stderr	None captured	None captured	None captured