Scrapfly Pi API Evaluation

Scrapfly

scrapfly.ioWebscraping

84/ 100

Score Breakdown84%

Lost points on 4 checks

time9/15
efficiency6/10
Context70/14
OpenAPI0/14

Eval Score (70% weight)90%

cost$0.00 (<$0.05, excellent)+10

time46s (30s–60s, great)+9

efficiency7 tool calls (≤10, great)+6

found docsTouched docs at scrapfly.io: yes (2 matching tool calls)+10

zero errorsNo errors in tool outputs+5

syntax validCode compiles/parses correctly+5

created filesGenerated files: 1 (need ≥1)+10

full executionMethod: full_execution, Exit: 0+35

Checklist Score (30% weight)71%

Context7

llms.txt

Link+14

MCP Server

Link+14

Typed SDK

Link+14

OpenAPI

Agent Skills

Link+14

CLI

Link+14

Checklist determined by AI. If something looks wrong, .

Final Score

A: >=90%B: 75-89%C: 55-74%D: <55%

(90 × 0.7) + (71 × 0.3)= 84%

Replay

Using https://scrapfly.io/docs, complete the following task:

Using the Scrapfly Python SDK, build me a script that scrapes web content:

1. Install the official Scrapfly Python SDK (pip install)
2. Scrape the page at "https://news.ycombinator.com"
3. Extract the top 5 story titles and their URLs
4. Print the results as JSON array with fields: rank, title, url

You MUST use the official Scrapfly Python SDK — do not make raw HTTP/REST calls.

scrape_hn.py

Unlock analytics

See Scrapfly's score trend, layer rankings, and competitive position.

Run completed Oct 20, 2026, 8:41 PM