fastCRW vs Scrapfly
Both ran the same Webscraping task · Same Webscraping task · View the taskView the task
CompanyClick a name to swap it
#1 in Webscraping · #1 overall
94ABest on 9 of 22
#2 in Webscraping · #25 overall
78BBest on 1 of 22
Compare up to 4.
MCP task scoring
Task score
96%
87%
Task
Passed+30The agent successfully completed all four required steps: (1) discovered available MCP tools and their capabilities thro...
Passed+30The agent successfully completed all required steps: (1) discovered MCP tools via ToolSearch, (2) scraped https://news.y...
Used MCP Correctly
Passed+20Agent made 1 MCP tool calls
Passed+20Agent made 1 MCP tool calls
Partial Credit
Passed+10Partial credit: 100%
Passed+10Partial credit: 100%
Zero Errors
Passed+10No errors
Passed+10No errors
Efficiency
Passed+103 tool calls (<=5, excellent)
Passed+103 tool calls (<=5, excellent)
Time
Partial+6110s (1-2min, great)
Partial+1.0349s (5-10min, very slow)
Cost
Passed+10$0.09 (<$0.10, excellent)
Partial+6$0.10 ($0.10-0.20, great)
Runtime (actual)Lower is better
1m 49s
5m 49s
Cost (actual)Lower is better
$0.0945
$0.1016
Tool callsLower is better
3
3
ErrorsLower is better
0
0
Tokens usedLower is better
114,196
123,438
MCP discovery
Discovery score
91%
59%
Official MCP
Passed5/5
Passed5/5
Auth Method
Passed15/15env var
Passed15/15env var
Tool Count
Passed10/109 tools, lean
Failed0/1051 tools, bloated
Tool Description Length
Passed10/101,978 tokens, lean
Failed0/1015,907 tokens, bloated
llms.txt
Passed10/10
Failed0/10
Output Schema
Failed0/5
Failed0/5
Tool Stability
Passed5/5
Passed5/5
Security Posture
Partial9/10No API keys or tokens visible in descriptions; llmApiKey parameter in crw_extract is properly typed as string with a cle...
Partial9/10No API keys or tokens visible in descriptions or schemas; parameters are clearly typed; minor concern is that info_api_k...
Tool API Mapping
Partial14/15Tools map cleanly 1:1 to individual API operations (scrape, crawl, extract, map, search, parse); each tool performs one...
Partial11/15Most tools map 1:1 to API operations (alert_get, alert_list, alert_delete), but several wrap workflows: alert_create inc...
Description Clarity
Partial13/15Descriptions clearly explain tool purpose and expected inputs/outputs; most tools include implementation details (e.g.,...
Partial14/15Descriptions are comprehensive and explain tool purpose, parameters, and workflows clearly; minor issues include some ne...
Eval details
Integration task
# Task
Using the fastCRW MCP, scrape web content:
1. Discover available MCP tools and their capabilities
2. Scrape the page at "https://news.ycombinator.com"
3. Extract the top 5...
# Task
Using the Scrapfly MCP, scrape web content:
1. Discover available MCP tools and their capabilities
2. Scrape the page at "https://news.ycombinator.com"
3. Extract the top...
Generated files
1
1
Trace tool calls
3
3
Completed
9/27/2026
10/14/2026
Stderr
None captured
None captured
#1 in Webscraping
94ABest on 9 of 22
#2 in Webscraping
78BBest on 1 of 22
MCP task scoring
Task score
96%
87%
Task
Passed+30The agent successfully completed all four required steps: (1) discovered available MCP tools and their capabilities thro...
Passed+30The agent successfully completed all required steps: (1) discovered MCP tools via ToolSearch, (2) scraped https://news.y...
Used MCP Correctly
Passed+20Agent made 1 MCP tool calls
Passed+20Agent made 1 MCP tool calls
Partial Credit
Passed+10Partial credit: 100%
Passed+10Partial credit: 100%
Zero Errors
Passed+10No errors
Passed+10No errors
Efficiency
Passed+103 tool calls (<=5, excellent)
Passed+103 tool calls (<=5, excellent)
Time
Partial+6110s (1-2min, great)
Partial+1.0349s (5-10min, very slow)
Cost
Passed+10$0.09 (<$0.10, excellent)
Partial+6$0.10 ($0.10-0.20, great)
Runtime (actual)Lower is better
1m 49s
5m 49s
Cost (actual)Lower is better
$0.0945
$0.1016
Tool callsLower is better
3
3
ErrorsLower is better
0
0
Tokens usedLower is better
114,196
123,438
MCP discovery
Discovery score
91%
59%
Official MCP
Passed5/5
Passed5/5
Auth Method
Passed15/15env var
Passed15/15env var
Tool Count
Passed10/109 tools, lean
Failed0/1051 tools, bloated
Tool Description Length
Passed10/101,978 tokens, lean
Failed0/1015,907 tokens, bloated
llms.txt
Passed10/10
Failed0/10
Output Schema
Failed0/5
Failed0/5
Tool Stability
Passed5/5
Passed5/5
Security Posture
Partial9/10No API keys or tokens visible in descriptions; llmApiKey parameter in crw_extract is properly typed as string with a cle...
Partial9/10No API keys or tokens visible in descriptions or schemas; parameters are clearly typed; minor concern is that info_api_k...
Tool API Mapping
Partial14/15Tools map cleanly 1:1 to individual API operations (scrape, crawl, extract, map, search, parse); each tool performs one...
Partial11/15Most tools map 1:1 to API operations (alert_get, alert_list, alert_delete), but several wrap workflows: alert_create inc...
Description Clarity
Partial13/15Descriptions clearly explain tool purpose and expected inputs/outputs; most tools include implementation details (e.g.,...
Partial14/15Descriptions are comprehensive and explain tool purpose, parameters, and workflows clearly; minor issues include some ne...
Eval details
Integration task
# Task
Using the fastCRW MCP, scrape web content:
1. Discover available MCP tools and their capabilities
2. Scrape the page at "https://news.ycombinator.com"
3. Extract the top 5...
# Task
Using the Scrapfly MCP, scrape web content:
1. Discover available MCP tools and their capabilities
2. Scrape the page at "https://news.ycombinator.com"
3. Extract the top...
Generated files
1
1
Trace tool calls
3
3
Completed
9/27/2026
10/14/2026
Stderr
None captured
None captured
Full eval