Olostep
Score Breakdown75%
Lost points on 4 checks
- time0/15
- efficiency1/10
- zero errors0/5
- Context70/14
Eval Score (70% weight)71%
cost$0.02 (<$0.05, excellent)+10
time418s (≥300s, too slow)+0
efficiency23 tool calls (≤25, below average)+1
found docsTouched docs at docs.olostep.com: yes (3 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 2+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(71 × 0.7) + (86 × 0.3)= 75%
Replay
Using https://docs.olostep.com, complete the following task: Using the Olostep Python SDK, build me a script that scrapes web content: 1. Install the official Olostep Python SDK (pip install) 2. Scrape the page at "https://news.ycombinator.com" 3. Extract the top 5 story titles and their URLs 4. Print the results as JSON array with fields: rank, title, url You MUST use the official Olostep Python SDK — do not make raw HTTP/REST calls.
scrape_hn.py
Unlock analytics
See Olostep's score trend, layer rankings, and competitive position.
Run completed Oct 28, 2026, 7:53 PM