Compare companies

Side-by-side API results for companies evaluated by Claude Code. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.

Model

Claude Code Codex

Codex

Tooling

API CLI MCP

Choose 2-4 companies

Selected

Company 1

Company 2

Selected

Company 1

Company 2

Prefect

Durable Workflow

fastCRW

Webscraping

Summary

Compare status

Comparable

Overall score

Best

Grade

Category

Durable Workflow

Webscraping

Overall rank

#17

Best

#43

Category rank

Best

Full eval

Open report

Agent Performance

Eval score

81%

Best

65%

Task success

Yes

Cost

$0.1687

Best

$0.5136

Tool calls

Best

Errors

Best

Runtime

1m 20s

Best

4m 13s

Tokens used

260,482

Best

745,117

Exit code

Best

Discoverability

Discovery score

86%

100%

Best

Context7

llms.txt

MCP Server

Typed SDK

OpenAPI

Best

Agent Skills

Yes

CLI

Yes

Eval Details

Integration task

# Task Using https://docs.prefect.io, complete the following task: Using the Prefect Python SDK, build me a script that defines and executes a simple 3-step workflow: 1. Install...

# Task Using https://docs.fastcrw.com/, complete the following task: Using the fastCRW Python SDK, build me a script that scrapes web content: 1. Install the official fastCRW Py...

Generated files

Trace tool calls

Completed

9/29/2026

9/23/2026

Stderr

None captured

Metric	Prefect Durable Workflow	fastCRW Webscraping
Summary
Compare status	Comparable	Comparable
Overall score	82 Best	75
Grade	B	B
Category	Durable Workflow	Webscraping
Overall rank	#17 Best	#43
Category rank	#1 Best	#2
Full eval	Open report	Open report
Agent Performance
Eval score	81% Best	65%
Task success	Yes	Yes
Cost	$0.1687 Best	$0.5136
Tool calls	10 Best	27
Errors	2 Best	4
Runtime	1m 20s Best	4m 13s
Tokens used	260,482 Best	745,117
Exit code	0 Best	0 Best
Discoverability
Discovery score	86%	100% Best
Context7	Yes	Yes
llms.txt	Yes	Yes
MCP Server	Yes	Yes
Typed SDK	Yes	Yes
OpenAPI	No	Yes Best
Agent Skills	Yes	Yes
CLI	Yes	Yes
Eval Details
Integration task	# Task Using https://docs.prefect.io, complete the following task: Using the Prefect Python SDK, build me a script that defines and executes a simple 3-step workflow: 1. Install...	# Task Using https://docs.fastcrw.com/, complete the following task: Using the fastCRW Python SDK, build me a script that scrapes web content: 1. Install the official fastCRW Py...
Generated files	1	2
Trace tool calls	10	27
Completed	9/29/2026	9/23/2026
Stderr	None captured	None captured