Back to leaderboard

AssemblyAI vs Deepgram

Same Voice STT task · View

#1 in Voice STT

86BBest on 0 of 14

#1 in Voice STT

86BBest on 4 of 14

Agent performance

Eval score
81%
81%
Task success
Passed
Passed
Cost per runLower is better
$0.1788
$0.1728
Tool callsLower is better
9
8
ErrorsLower is better
1
1
RuntimeLower is better
1m 20s
1m
Tokens usedLower is better
238,001
192,334

Discoverability

Discovery score
100%
100%
Context7
llms.txt
MCP Server
Typed SDK
OpenAPI
Agent Skills

Eval details

Integration task
# Task Using https://www.assemblyai.com/docs, complete the following task: Using the AssemblyAI Python SDK, build me a script that transcribes a sample audio file: 1. Install th...
# Task Using https://developers.deepgram.com/docs, complete the following task: Using the Deepgram Python SDK, build me a script that transcribes a sample audio file: 1. Install...
Generated files
1
1
Trace tool calls
9
8
Completed
9/23/2026
9/26/2026
Stderr
None captured
None captured