Back to leaderboard

fastCRW

Same Webscraping task · View

#1 in Webscraping

94A

MCP task scoring

Task score
96%
Task
Passed+30The agent successfully completed all four required steps: (1) discovered available MCP tools and their capabilities thro...
Used MCP Correctly
Passed+20Agent made 1 MCP tool calls
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Passed+10No errors
Efficiency
Passed+103 tool calls (<=5, excellent)
Time
Partial+6110s (1-2min, great)
Cost
Passed+10$0.09 (<$0.10, excellent)
Runtime (actual)Lower is better
1m 49s
Cost (actual)Lower is better
$0.0945
Tool callsLower is better
3
ErrorsLower is better
0
Tokens usedLower is better
114,196

MCP discovery

Discovery score
91%
Official MCP
Passed5/5
Auth Method
Passed15/15env var
Tool Count
Passed10/109 tools, lean
Tool Description Length
Passed10/101,978 tokens, lean
llms.txt
Passed10/10
Output Schema
Failed0/5
Tool Stability
Passed5/5
Security Posture
Partial9/10No API keys or tokens visible in descriptions; llmApiKey parameter in crw_extract is properly typed as string with a cle...
Tool API Mapping
Partial14/15Tools map cleanly 1:1 to individual API operations (scrape, crawl, extract, map, search, parse); each tool performs one...
Description Clarity
Partial13/15Descriptions clearly explain tool purpose and expected inputs/outputs; most tools include implementation details (e.g.,...

Eval details

Integration task
# Task Using the fastCRW MCP, scrape web content: 1. Discover available MCP tools and their capabilities 2. Scrape the page at "https://news.ycombinator.com" 3. Extract the top 5...
Generated files
1
Trace tool calls
3
Completed
9/27/2026
Stderr
None captured
Full eval