Compare companies

Side-by-side CLI results for companies evaluated by Codex. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.

Model

Claude Code Codex

Codex

Tooling

API CLI MCP

Choose 2-4 companies

Selected

Company 1

Company 2

Showing the first two companies on mobile. Use a wider screen to compare 3 companies.

Selected

Company 1

Company 2

Company 3

Mobile compare is limited to two companies. Use a wider screen to compare all 3.

Jina AI

Deepgram

Voice STT

Summary

Compare status

Comparable

Overall score

Best

Grade

Category

Voice STT

Overall rank

Best

Category rank

Best

Full eval

Open report

CLI Task Scoring

Eval score

85%

Best

85%

Best

Task Completed

Passed+30The agent successfully completed all required steps using the official jina CLI. Both searches were performed (broad and...

Best

Passed+30The agent successfully completed all required steps: (1) downloaded the sample audio file using curl, (2) installed the...

Best

Used CLI Correctly

Passed+20Agent used CLI commands correctly

Best

Passed+20Agent used CLI commands correctly

Best

Partial Credit

Passed+10Partial credit: 100%

Best

Passed+10Partial credit: 100%

Best

Zero Errors

Passed+10No errors

Best

Passed+10No errors

Best

Efficiency

Partial+3.511 tool calls (<=15, good)

Best

Partial+3.511 tool calls (<=15, good)

Best

Time

Partial+694s (1-2min, great)

Best

Partial+6103s (1-2min, great)

Best

Cost

Partial+6$0.14 ($0.10-0.20, great)

Best

Partial+6$0.11 ($0.10-0.20, great)

Best

Runtime (actual)

1m 34s

Best

1m 42s

Cost (actual)

$0.1409

$0.1075

Best

Tool calls

Best

Errors

Best

Tokens used

401,726

374,221

Best

CLI Discovery

Discovery score

70%

95%

Best

CLI exists

Passed5/5jina

Best

Passed5/5dg

Best

Install docs

Passed5/5pip

Best

Passed5/5pip

Best

Auth method

Passed25/25env var

Best

Passed25/25env var

Best

Non-interactive

Failed0/25none

Passed25/25auto detect

Best

JSON output

Passed15/15full

Best

Passed15/15full

Best

llms.txt

Failed0/5

Best

Failed0/5

Best

Agent skill

Passed20/20

Best

Passed20/20

Best

Eval Details

Integration task

# Task Using the jina CLI (Jina AI), run a small research workflow: 1. Run TWO related searches to build a picture of a topic: a. A broad query: "grid-scale battery storage ad...

# Task Using the dg CLI (Deepgram), transcribe a sample audio file: 1. Download this sample audio file: https://storage.googleapis.com/aai-web-samples/5_common_sports_injuries...

Generated files

Trace tool calls

Completed

9/27/2026

Stderr

None captured

Metric	Jina AI Search	Deepgram Voice STT	WorkOS Auth
Summary
Compare status	Comparable	Comparable	Comparable
Overall score	80	88 Best	79
Grade	B	B	B
Category	Search	Voice STT	Auth
Overall rank	#9	#4 Best	#10
Category rank	#2	#1 Best	#1 Best
Full eval	Open report	Open report	Open report
CLI Task Scoring
Eval score	85% Best	85% Best	73%
Task Completed	Passed+30The agent successfully completed all required steps using the official jina CLI. Both searches were performed (broad and... Best	Passed+30The agent successfully completed all required steps: (1) downloaded the sample audio file using curl, (2) installed the... Best	Passed+30The agent successfully completed all required tasks using the workos CLI. It installed the official CLI via npm, explore... Best
Used CLI Correctly	Passed+20Agent used CLI commands correctly Best	Passed+20Agent used CLI commands correctly Best	Passed+20Agent used CLI commands correctly Best
Partial Credit	Passed+10Partial credit: 100% Best	Passed+10Partial credit: 100% Best	Passed+10Partial credit: 100% Best
Zero Errors	Passed+10No errors Best	Passed+10No errors Best	Failed+0Failed tool calls: 2
Efficiency	Partial+3.511 tool calls (<=15, good) Best	Partial+3.511 tool calls (<=15, good) Best	Partial+1.021 tool calls (<=25, below average)
Time	Partial+694s (1-2min, great) Best	Partial+6103s (1-2min, great) Best	Partial+680s (1-2min, great) Best
Cost	Partial+6$0.14 ($0.10-0.20, great) Best	Partial+6$0.11 ($0.10-0.20, great) Best	Partial+6$0.13 ($0.10-0.20, great) Best
Runtime (actual)	1m 34s	1m 42s	1m 19s Best
Cost (actual)	$0.1409	$0.1075 Best	$0.1349
Tool calls	11 Best	11 Best	21
Errors	0 Best	0 Best	2
Tokens used	401,726	374,221 Best	467,179
CLI Discovery
Discovery score	70%	95% Best	95% Best
CLI exists	Passed5/5jina Best	Passed5/5dg Best	Passed5/5workos Best
Install docs	Passed5/5pip Best	Passed5/5pip Best	Passed5/5npm Best
Auth method	Passed25/25env var Best	Passed25/25env var Best	Passed25/25env var Best
Non-interactive	Failed0/25none	Passed25/25auto detect Best	Passed25/25auto detect Best
JSON output	Passed15/15full Best	Passed15/15full Best	Passed15/15full Best
llms.txt	Failed0/5 Best	Failed0/5 Best	Failed0/5 Best
Agent skill	Passed20/20 Best	Passed20/20 Best	Passed20/20 Best
Eval Details
Integration task	# Task Using the jina CLI (Jina AI), run a small research workflow: 1. Run TWO related searches to build a picture of a topic: a. A broad query: "grid-scale battery storage ad...	# Task Using the dg CLI (Deepgram), transcribe a sample audio file: 1. Download this sample audio file: https://storage.googleapis.com/aai-web-samples/5_common_sports_injuries...	# Task Using the workos CLI (WorkOS), perform the following user and organization management tasks: 1. Explore available commands: `workos --help` 2. List all existing users: `wo...
Generated files	1	1	1
Trace tool calls	11	11	21
Completed	9/27/2026	9/27/2026	9/27/2026
Stderr	None captured	None captured	None captured