AssemblyAI
93/ 100
AScore Breakdown93%
Lost points on 2 checks
- time9/15
- efficiency6/10
Eval Score (70% weight)90%
cost$0.00 (<$0.05, excellent)+10
time59s (30s–60s, great)+9
efficiency8 tool calls (≤10, great)+6
found docsTouched docs at assemblyai.com: yes (4 matching tool calls)+10
zero errorsNo errors in tool outputs+5
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(90 × 0.7) + (100 × 0.3)= 93%
Replay
Using https://www.assemblyai.com/docs, complete the following task: Using the AssemblyAI Python SDK, build me a script that transcribes a sample audio file: 1. Install the official AssemblyAI Python SDK (pip install) 2. Transcribe this audio file and print the transcribed text: https://storage.googleapis.com/aai-web-samples/5_common_sports_injuries.mp3 3. If the SDK expects a local file, download the audio first 4. Print the transcription to stdout You MUST use the official AssemblyAI Python SDK — do not make raw HTTP/REST calls.
transcribe.py
Unlock analytics
See AssemblyAI's score trend, layer rankings, and competitive position.
Run completed Oct 20, 2026, 8:14 PM