Back to leaderboard
Compare companies
Side-by-side MCP results for companies evaluated by Claude Code. Compare score, rank, discoverability, cost, errors, runtime, and the underlying eval artifacts.
Model
Claude Code
CodexChoose 2-4 companies
Selected
Showing the first two companies on mobile. Use a wider screen to compare 3 companies.
Selected
Mobile compare is limited to two companies. Use a wider screen to compare all 3.
fastCRW
Webscraping
Qdrant
Vector Databases
Summary
Compare status
Comparable
Comparable
Overall score
94
Best90
Grade
A
A
Category
Webscraping
Vector Databases
Overall rank
#1
Best#2
Category rank
#1
Best#1
BestFull eval
MCP Task Scoring
Task score
96%
Best92%
Task
Passed+30The agent successfully completed all four required steps: (1) discovered available MCP tools and their capabilities thro...
BestPassed+30The agent successfully completed all required steps using only MCP tools. It stored 3 FAQ-style entries about [REDACTED:...
BestUsed MCP Correctly
Passed+20Agent made 1 MCP tool calls
BestPassed+20Agent made 4 MCP tool calls
BestPartial Credit
Passed+10Partial credit: 100%
BestPassed+10Partial credit: 100%
BestZero Errors
Passed+10No errors
BestPassed+10No errors
BestEfficiency
Passed+103 tool calls (<=5, excellent)
BestPartial+66 tool calls (<=10, great)
Time
Partial+6110s (1-2min, great)
BestPartial+677s (1-2min, great)
BestCost
Passed+10$0.09 (<$0.10, excellent)
BestPassed+10$0.08 (<$0.10, excellent)
BestRuntime (actual)
1m 49s
1m 17s
BestCost (actual)
$0.0945
$0.0786
BestTool calls
3
Best6
Errors
0
Best0
BestTokens used
114,196
Best116,404
MCP Discovery
Discovery score
91%
Best88%
Official MCP
Passed5/5
BestPassed5/5
BestAuth Method
Passed15/15env var
BestPassed15/15env var
BestTool Count
Passed10/109 tools, lean
BestPassed10/102 tools, lean
BestTool Description Length
Passed10/101,978 tokens, lean
BestPassed10/10226 tokens, lean
Bestllms.txt
Passed10/10
BestPassed10/10
BestOutput Schema
Failed0/5
BestFailed0/5
BestTool Stability
Passed5/5
BestPassed5/5
BestSecurity Posture
Partial9/10No API keys or tokens visible in descriptions; llmApiKey parameter in crw_extract is properly typed as string with a cle...
BestPartial9/10No API keys, tokens, or credentials are visible in descriptions or schemas; however, the metadata parameter accepts arbi...
BestTool API Mapping
Partial14/15Tools map cleanly 1:1 to individual API operations (scrape, crawl, extract, map, search, parse); each tool performs one...
BestPartial14/15Tools map cleanly 1:1 to individual vector database operations (search and upsert/insert), with minimal workflow wrappin...
BestDescription Clarity
Partial13/15Descriptions clearly explain tool purpose and expected inputs/outputs; most tools include implementation details (e.g.,...
BestPartial10/15Descriptions explain the basic purpose of each tool (find vs. store memories), but lack detail about search behavior, re...
Eval Details
Integration task
# Task
Using the fastCRW MCP, scrape web content:
1. Discover available MCP tools and their capabilities
2. Scrape the page at "https://news.ycombinator.com"
3. Extract the top 5...
# Task
Using the Qdrant MCP, perform semantic memory operations:
1. Use the MCP tools relevant to storing and finding memories. You do not need to enumerate the full tool catalog...
Generated files
1
1
Trace tool calls
3
6
Completed
9/27/2026
10/4/2026
Stderr
None captured
None captured