Compare companies

Side-by-side CLI results for companies evaluated by Codex. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.

Model

Claude Code Codex

Codex

Tooling

API CLI MCP

Choose 2-4 companies

Selected

Company 1

Company 2

Showing the first two companies on mobile. Use a wider screen to compare 3 companies.

Selected

Company 1

Company 2

Company 3

Mobile compare is limited to two companies. Use a wider screen to compare all 3.

Resend

LiveKit

Voice Infra

Summary

Compare status

Comparable

Overall score

Best

Grade

Category

Voice Infra

Overall rank

Best

Category rank

Best

Full eval

Open report

CLI Task Scoring

Eval score

88%

89%

Best

Task Completed

Passed+30The agent successfully completed all required tasks using the official Resend CLI. It installed resend-cli via npm, auth...

Best

Passed+30The agent successfully completed all required tasks using the official `lk` CLI. It installed the CLI via the official i...

Best

Used CLI Correctly

Passed+20Agent used CLI commands correctly

Best

Passed+20Agent used CLI commands correctly

Best

Partial Credit

Passed+10Partial credit: 100%

Best

Passed+10Partial credit: 100%

Best

Zero Errors

Passed+10No errors

Best

Passed+10No errors

Best

Efficiency

Partial+2.020 tool calls (<=20, acceptable)

Partial+3.515 tool calls (<=15, good)

Best

Time

Partial+668s (1-2min, great)

Best

Partial+675s (1-2min, great)

Best

Cost

Passed+10$0.10 (<$0.10, excellent)

Best

Passed+10$0.10 (<$0.10, excellent)

Best

Runtime (actual)

1m 8s

Best

1m 15s

Cost (actual)

$0.0951

Best

$0.0965

Tool calls

Best

Errors

Best

Tokens used

323,575

Best

360,038

CLI Discovery

Discovery score

100%

Best

93%

CLI exists

Passed5/5resend

Best

Passed5/5lk

Best

Install docs

Passed5/5npm

Best

Passed5/5binary download

Best

Auth method

Passed25/25env var

Best

Passed25/25env var

Best

Non-interactive

Passed25/25auto detect

Best

Partial18/25flag

JSON output

Passed15/15full

Best

Passed15/15full

Best

llms.txt

Passed5/5

Best

Passed5/5

Best

Agent skill

Passed20/20

Best

Passed20/20

Best

Eval Details

Integration task

# Task Using the resend CLI (Resend), perform email operations: 1. Create a new email inbox (or list available inboxes) 2. Send an email from an inbox to a ***** email with subje...

# Task Using the lk CLI (LiveKit), manage real-time rooms: 1. List existing rooms: `lk room list` 2. Create a new room called "*****-leaderboard-room": `lk room create *****-lead...

Generated files

Trace tool calls

Completed

9/27/2026

Stderr

None captured

Metric	Resend Email	LiveKit Voice Infra	Agentmail Email
Summary
Compare status	Comparable	Comparable	Comparable
Overall score	91 Best	90	89
Grade	A	A	B
Category	Email	Voice Infra	Email
Overall rank	#1 Best	#2	#3
Category rank	#1 Best	#1 Best	#2
Full eval	Open report	Open report	Open report
CLI Task Scoring
Eval score	88%	89% Best	85%
Task Completed	Passed+30The agent successfully completed all required tasks using the official Resend CLI. It installed resend-cli via npm, auth... Best	Passed+30The agent successfully completed all required tasks using the official `lk` CLI. It installed the CLI via the official i... Best	Passed+30The agent successfully completed all required email operations using the agentmail CLI binary. The agent: (1) listed ava... Best
Used CLI Correctly	Passed+20Agent used CLI commands correctly Best	Passed+20Agent used CLI commands correctly Best	Passed+20Agent used CLI commands correctly Best
Partial Credit	Passed+10Partial credit: 100% Best	Passed+10Partial credit: 100% Best	Passed+10Partial credit: 100% Best
Zero Errors	Passed+10No errors Best	Passed+10No errors Best	Passed+10No errors Best
Efficiency	Partial+2.020 tool calls (<=20, acceptable)	Partial+3.515 tool calls (<=15, good) Best	Partial+3.514 tool calls (<=15, good) Best
Time	Partial+668s (1-2min, great) Best	Partial+675s (1-2min, great) Best	Partial+693s (1-2min, great) Best
Cost	Passed+10$0.10 (<$0.10, excellent) Best	Passed+10$0.10 (<$0.10, excellent) Best	Partial+6$0.16 ($0.10-0.20, great)
Runtime (actual)	1m 8s Best	1m 15s	1m 33s
Cost (actual)	$0.0951 Best	$0.0965	$0.1558
Tool calls	20	15	14 Best
Errors	0 Best	0 Best	0 Best
Tokens used	323,575	360,038	305,861 Best
CLI Discovery
Discovery score	100% Best	93%	100% Best
CLI exists	Passed5/5resend Best	Passed5/5lk Best	Passed5/5agentmail Best
Install docs	Passed5/5npm Best	Passed5/5binary download Best	Passed5/5npm Best
Auth method	Passed25/25env var Best	Passed25/25env var Best	Passed25/25env var Best
Non-interactive	Passed25/25auto detect Best	Partial18/25flag	Passed25/25auto detect Best
JSON output	Passed15/15full Best	Passed15/15full Best	Passed15/15full Best
llms.txt	Passed5/5 Best	Passed5/5 Best	Passed5/5 Best
Agent skill	Passed20/20 Best	Passed20/20 Best	Passed20/20 Best
Eval Details
Integration task	# Task Using the resend CLI (Resend), perform email operations: 1. Create a new email inbox (or list available inboxes) 2. Send an email from an inbox to a ***** email with subje...	# Task Using the lk CLI (LiveKit), manage real-time rooms: 1. List existing rooms: `lk room list` 2. Create a new room called "***-leaderboard-room": `lk room create ***-lead...	# Task Using the agentmail CLI (Agentmail), perform email operations: 1. Create a new email inbox (or list available inboxes) 2. Send an email from an inbox to "support@lightsage...
Generated files	1	1	1
Trace tool calls	20	15	14
Completed	9/27/2026	9/27/2026	10/15/2026
Stderr	None captured	None captured	None captured