Reducto
Score Breakdown84%
Lost points on 4 checks
- cost6/10
- time9/15
- efficiency3/10
- zero errors0/5
Eval Score (70% weight)78%
cost$0.18 ($0.10–0.20, great)+6
time94s (1–2min, great)+9
efficiency13 tool calls (≤15, good)+3
found docsTouched docs at docs.reducto.ai: yes (1 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 1+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0 (manually verified false-negative correction)+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(78 × 0.7) + (100 × 0.3)= 84%
Replay
Using https://docs.reducto.ai/quickstart, complete the following task: Using Reducto, build me a script that parses this PDF and extracts structured data: https://www.irs.gov/pub/irs-pdf/fw9.pdf Print the result as JSON with fields: pages (total count), chunks (array of text blocks), tables (array if any found)
parse_document.py
Unlock analytics
See Reducto's score trend, layer rankings, and competitive position.
Run completed Sep 26, 2026, 1:23 PM