Back to leaderboard

fastCRW vs Scrapfly

Same Webscraping task · View

#1 in Webscraping

94ABest on 9 of 22

#2 in Webscraping

78BBest on 1 of 22

MCP task scoring

Task score
96%
87%
Task
Passed+30The agent successfully completed all four required steps: (1) discovered available MCP tools and their capabilities thro...
Passed+30The agent successfully completed all required steps: (1) discovered MCP tools via ToolSearch, (2) scraped https://news.y...
Used MCP Correctly
Passed+20Agent made 1 MCP tool calls
Passed+20Agent made 1 MCP tool calls
Partial Credit
Passed+10Partial credit: 100%
Passed+10Partial credit: 100%
Zero Errors
Passed+10No errors
Passed+10No errors
Efficiency
Passed+103 tool calls (<=5, excellent)
Passed+103 tool calls (<=5, excellent)
Time
Partial+6110s (1-2min, great)
Partial+1.0349s (5-10min, very slow)
Cost
Passed+10$0.09 (<$0.10, excellent)
Partial+6$0.10 ($0.10-0.20, great)
Runtime (actual)Lower is better
1m 49s
5m 49s
Cost (actual)Lower is better
$0.0945
$0.1016
Tool callsLower is better
3
3
ErrorsLower is better
0
0
Tokens usedLower is better
114,196
123,438

MCP discovery

Discovery score
91%
59%
Official MCP
Passed5/5
Passed5/5
Auth Method
Passed15/15env var
Passed15/15env var
Tool Count
Passed10/109 tools, lean
Failed0/1051 tools, bloated
Tool Description Length
Passed10/101,978 tokens, lean
Failed0/1015,907 tokens, bloated
llms.txt
Passed10/10
Failed0/10
Output Schema
Failed0/5
Failed0/5
Tool Stability
Passed5/5
Passed5/5
Security Posture
Partial9/10No API keys or tokens visible in descriptions; llmApiKey parameter in crw_extract is properly typed as string with a cle...
Partial9/10No API keys or tokens visible in descriptions or schemas; parameters are clearly typed; minor concern is that info_api_k...
Tool API Mapping
Partial14/15Tools map cleanly 1:1 to individual API operations (scrape, crawl, extract, map, search, parse); each tool performs one...
Partial11/15Most tools map 1:1 to API operations (alert_get, alert_list, alert_delete), but several wrap workflows: alert_create inc...
Description Clarity
Partial13/15Descriptions clearly explain tool purpose and expected inputs/outputs; most tools include implementation details (e.g.,...
Partial14/15Descriptions are comprehensive and explain tool purpose, parameters, and workflows clearly; minor issues include some ne...

Eval details

Integration task
# Task Using the fastCRW MCP, scrape web content: 1. Discover available MCP tools and their capabilities 2. Scrape the page at "https://news.ycombinator.com" 3. Extract the top 5...
# Task Using the Scrapfly MCP, scrape web content: 1. Discover available MCP tools and their capabilities 2. Scrape the page at "https://news.ycombinator.com" 3. Extract the top...
Generated files
1
1
Trace tool calls
3
3
Completed
9/27/2026
10/14/2026
Stderr
None captured
None captured