Vapi
79/ 100
BScore Breakdown79%
Lost points on 3 checks
- time0/15
- efficiency0/10
- zero errors0/5
Eval Score (70% weight)70%
cost$0.01 (<$0.10, excellent)+10
time882s (≥10min, too slow)+0
efficiency33 tool calls (>25, inefficient)+0
found docsTouched docs at docs.vapi.ai: yes (1 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 1+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 8 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(70 × 0.7) + (100 × 0.3)= 79%
Replay
Using https://docs.vapi.ai, complete the following task: Using the Vapi Python SDK, build me a script that performs a voice telephony workflow: 1. Install the official Vapi Python SDK (pip install) 2. Check the Vapi documentation to determine the easiest programmable voice workflow 3. **Preferred:** Create a ***** outbound voice call to "+12015550123" using a valid sandbox/***** caller ID and print the API response as JSON. If the provider requires a public answer URL, callback URL, or hosted instructions, use a simple public example from the official docs. 4. **If outbound voice calls are not practical in ***** mode but telephony messaging is supported:** Send a ***** SMS message to "+12015550123" and print the API response as JSON. 5. Print the response fields that identify the call or message and its status You MUST use the official Vapi Python SDK — do not make raw HTTP/REST calls.
*****_raw.py
Unlock analytics
See Vapi's score trend, layer rankings, and competitive position.
Run completed Oct 21, 2026, 12:25 AM