Datadog
Score Breakdown81%
Lost points on 4 checks
- cost3/10
- time9/15
- efficiency2/10
- zero errors0/5
Eval Score (70% weight)74%
cost$0.30 ($0.20–0.40, good)+3
time109s (1–2min, great)+9
efficiency18 tool calls (≤20, acceptable)+2
found docsTouched docs at docs.datadoghq.com: yes (4 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 3+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(74 × 0.7) + (100 × 0.3)= 81%
Replay
Using https://docs.datadoghq.com/api/la*****/, complete the following task: Using Datadog: 1. Submit a custom metric called "*****.leaderboard.score" with value 42 and tags ["env:*****", "leaderboard:sapient"] 2. Create an event with title "Leaderboard Test" and text "Integration ***** event from Lightsage Leaderboard" 3. Print the API responses as JSON, including the status of each operation.
datadog_reporter.py
Unlock analytics
See Datadog's score trend, layer rankings, and competitive position.
Run completed Sep 23, 2026, 4:11 AM