Compare companies

Side-by-side API results for companies evaluated by Codex. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.

Model

Claude Code Codex

Codex

Tooling

API CLI MCP

Choose 2-4 companies

Selected

Company 1

Company 2

Showing the first two companies on mobile. Use a wider screen to compare 3 companies.

Selected

Company 1

Company 2

Company 3

Mobile compare is limited to two companies. Use a wider screen to compare all 3.

AssemblyAI

Voice STT

Fireworks AI

Inference

Summary

Compare status

Comparable

No tokens used recorded

Overall score

—

Grade

—

Category

Voice STT

Inference

Overall rank

—

Category rank

—

Full eval

Open report

Agent Performance

Eval score

76%

—

Task success

Yes

—

Cost

$0.2153

—

Tool calls

—

Errors

—

Runtime

1m 10s

—

Tokens used

305,255

—

Exit code

—

Discoverability

Discovery score

100%

—

Context7

Yes

—

llms.txt

Yes

—

MCP Server

Yes

—

Typed SDK

Yes

—

OpenAPI

Yes

—

Agent Skills

Yes

—

CLI

Yes

—

Eval Details

Integration task

# Task Using https://www.assemblyai.com/docs, complete the following task: Using the AssemblyAI Python SDK, build me a script that transcribes a sample audio file: 1. Install th...

—

Generated files

—

Trace tool calls

—

Completed

9/27/2026

—

Stderr

None captured

—

Metric	AssemblyAI Voice STT	Fireworks AI Inference	Deepgram Voice STT
Summary
Compare status	Comparable	No tokens used recorded	Comparable
Overall score	83	—	86 Best
Grade	B	—	B
Category	Voice STT	Inference	Voice STT
Overall rank	#7	—	#3 Best
Category rank	#2	—	#1 Best
Full eval	Open report	Open report	Open report
Agent Performance
Eval score	76%	—	80% Best
Task success	Yes	—	Yes
Cost	$0.2153 Best	—	$0.2314
Tool calls	14 Best	—	16
Errors	1 Best	—	1 Best
Runtime	1m 10s	—	46s Best
Tokens used	305,255 Best	—	307,782
Exit code	0 Best	—	0 Best
Discoverability
Discovery score	100% Best	—	100% Best
Context7	Yes	—	Yes
llms.txt	Yes	—	Yes
MCP Server	Yes	—	Yes
Typed SDK	Yes	—	Yes
OpenAPI	Yes	—	Yes
Agent Skills	Yes	—	Yes
CLI	Yes	—	Yes
Eval Details
Integration task	# Task Using https://www.assemblyai.com/docs, complete the following task: Using the AssemblyAI Python SDK, build me a script that transcribes a sample audio file: 1. Install th...	—	# Task Using https://developers.deepgram.com/docs, complete the following task: Using the Deepgram Python SDK, build me a script that transcribes a sample audio file: 1. Install...
Generated files	1	—	1
Trace tool calls	14	—	16
Completed	9/27/2026	—	9/27/2026
Stderr	None captured	—	None captured