Compare companies

Side-by-side API results for companies evaluated by Hermes. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.

Model

Claude Code Codex

Codex

Tooling

API CLI MCP

Choose 2-4 companies

Selected

Company 1

Company 2

Showing the first two companies on mobile. Use a wider screen to compare 3 companies.

Selected

Company 1

Company 2

Company 3

Mobile compare is limited to two companies. Use a wider screen to compare all 3.

OpenAI Whisper

Voice STT

Prefect

Durable Workflow

Summary

Compare status

Comparable

Overall score

Best

Grade

Category

Voice STT

Durable Workflow

Overall rank

Best

Category rank

Best

Full eval

Open report

Agent Performance

Eval score

94%

Best

90%

Task success

Yes

Cost

$0.0020

Best

$0.0043

Tool calls

Best

Errors

Best

Runtime

47s

Best

54s

Tokens used

47,089

Best

104,784

Exit code

Best

Discoverability

Discovery score

100%

Best

100%

Best

Context7

llms.txt

MCP Server

Typed SDK

OpenAPI

Agent Skills

CLI

Eval Details

Integration task

# Task Using https://platform.openai.com/docs, complete the following task: Using the OpenAI Whisper Python SDK, build me a script that transcribes a sample audio file: 1. Insta...

# Task Using https://docs.prefect.io, complete the following task: Using the Prefect Python SDK, build me a script that defines and executes a simple 3-step workflow: 1. Install...

Generated files

Trace tool calls

Completed

10/25/2026

Stderr

None captured

Metric	OpenAI Whisper Voice STT	Prefect Durable Workflow	fastCRW Webscraping
Summary
Compare status	Comparable	Comparable	Comparable
Overall score	95 Best	93	93
Grade	A	A	A
Category	Voice STT	Durable Workflow	Webscraping
Overall rank	#1 Best	#2	#2
Category rank	#1 Best	#1 Best	#1 Best
Full eval	Open report	Open report	Open report
Agent Performance
Eval score	94% Best	90%	90%
Task success	Yes	Yes	Yes
Cost	$0.0020 Best	$0.0043	$0.0033
Tool calls	5 Best	8	10
Errors	0 Best	0 Best	0 Best
Runtime	47s	54s	34s Best
Tokens used	47,089 Best	104,784	117,593
Exit code	0 Best	0 Best	0 Best
Discoverability
Discovery score	100% Best	100% Best	100% Best
Context7	Yes	Yes	Yes
llms.txt	Yes	Yes	Yes
MCP Server	Yes	Yes	Yes
Typed SDK	Yes	Yes	Yes
OpenAPI	Yes	Yes	Yes
Agent Skills	Yes	Yes	Yes
CLI	Yes	Yes	Yes
Eval Details
Integration task	# Task Using https://platform.openai.com/docs, complete the following task: Using the OpenAI Whisper Python SDK, build me a script that transcribes a sample audio file: 1. Insta...	# Task Using https://docs.prefect.io, complete the following task: Using the Prefect Python SDK, build me a script that defines and executes a simple 3-step workflow: 1. Install...	# Task Using https://docs.fastcrw.com/, complete the following task: Using the fastCRW Python SDK, build me a script that scrapes web content: 1. Install the official fastCRW Py...
Generated files	1	1	1
Trace tool calls	5	8	10
Completed	10/25/2026	10/25/2026	10/25/2026
Stderr	None captured	None captured	None captured