LiveKit
74/ 100
CScore Breakdown74%
Lost points on 4 checks
- time0/15
- efficiency0/10
- zero errors0/5
- OpenAPI0/14
Eval Score (70% weight)70%
cost$0.00 (<$0.05, excellent)+10
time448s (≥300s, too slow)+0
efficiency26 tool calls (>25, inefficient)+0
found docsTouched docs at docs.livekit.io: yes (2 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 1+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(70 × 0.7) + (86 × 0.3)= 74%
Replay
Using https://docs.livekit.io, complete the following task: Using the LiveKit Python SDK, build me a script that manages real-time voice infrastructure: 1. Install the official LiveKit Python SDK (pip install) 2. List existing rooms or sessions and print them as JSON 3. Create a new room/session called "*****-leaderboard-room" 4. List rooms/sessions again to confirm the new one appears 5. If the SDK supports it, generate a join token or connection details for the room/session and print them 6. Print output clearly labeled (e.g., "=== BEFORE ===", "=== CREATED ===", "=== AFTER ===", "=== TOKEN ===") You MUST use the official LiveKit Python SDK — do not make raw HTTP/REST calls.
livekit_voice_infra.py
Unlock analytics
See LiveKit's score trend, layer rankings, and competitive position.
Run completed Oct 20, 2026, 8:28 PM