Get notified
Pipecat

Pipecat

pipecat.aiVoice InfraHermesHermes
81/ 100
B
Score Breakdown81%

Lost points on 3 checks

  • time3/15
  • efficiency1/10
  • zero errors0/5
Eval Score (70% weight)74%
cost$0.02 (<$0.05, excellent)+10
time145s (90s–150s, slow)+3
efficiency24 tool calls (≤25, below average)+1
found docsTouched docs at docs.pipecat.ai: yes (6 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 2+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Checklist Score (30% weight)100%
Context7
Link+14
llms.txt
Link+14
MCP Server
Link+14
Typed SDK
Link+14
OpenAPI
Link+14
Agent Skills
Link+14
CLI
Link+14

Checklist determined by AI. If something looks wrong, .

Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(74 × 0.7) + (100 × 0.3)= 81%
Replay
Using https://docs.pipecat.ai/, complete the following task:

Using the Pipecat Python SDK, build me a script that manages real-time voice infrastructure:

1. Install the official Pipecat Python SDK (pip install)
2. List existing rooms or sessions and print them as JSON
3. Create a new room/session called "*****-leaderboard-room"
4. List rooms/sessions again to confirm the new one appears
5. If the SDK supports it, generate a join token or connection details for the room/session and print them
6. Print output clearly labeled (e.g., "=== BEFORE ===", "=== CREATED ===", "=== AFTER ===", "=== TOKEN ===")

You MUST use the official Pipecat Python SDK — do not make raw HTTP/REST calls.
pipecat_voice_infra.py

Unlock analytics

See Pipecat's score trend, layer rankings, and competitive position.

Run completed Oct 25, 2026, 11:28 PM