Olostep
Score Breakdown81%
Lost points on 3 checks
- time3/15
- efficiency2/10
- Context70/14
Eval Score (70% weight)80%
cost$0.01 (<$0.05, excellent)+10
time116s (90s–150s, slow)+3
efficiency19 tool calls (≤20, acceptable)+2
found docsTouched docs at docs.olostep.com: yes (10 matching tool calls)+10
zero errorsNo errors in tool outputs+5
syntax validCode compiles/parses correctly+5
created filesGenerated files: 2 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(80 × 0.7) + (86 × 0.3)= 81%
Replay
Using https://docs.olostep.com, complete the following task: Using the Olostep Python SDK, build me a script that scrapes web content: 1. Install the official Olostep Python SDK (pip install) 2. Scrape the page at "https://news.ycombinator.com" 3. Extract the top 5 story titles and their URLs 4. Print the results as JSON array with fields: rank, title, url You MUST use the official Olostep Python SDK — do not make raw HTTP/REST calls.
scrape_hn.py
Unlock analytics
See Olostep's score trend, layer rankings, and competitive position.
Run completed Oct 28, 2026, 7:58 PM