Deepgram
All 1 ran the same Voice STT task · Same Voice STT task · View the taskView the task
CompanyClick a name to swap it
#1 in Voice STT · tied #1 overall
92A
Compare up to 4. Next in Voice STT:
CLI task scoring
Eval score
92%
Task Completed
Passed+30The agent successfully completed all task requirements: (1) installed the official `dg` CLI via `pip install deepctl`, (...
Used CLI Correctly
Passed+20Agent used CLI commands correctly
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Passed+10No errors
Efficiency
Partial+67 tool calls (<=10, great)
Time
Partial+6109s (1-2min, great)
Cost
Passed+10$0.10 (<$0.10, excellent)
Runtime (actual)Lower is better
1m 49s
Cost (actual)Lower is better
$0.0959
Tool callsLower is better
7
ErrorsLower is better
0
Tokens usedLower is better
181,457
CLI discovery
Discovery score
95%
CLI exists
Passed5/5dg
Install docs
Passed5/5pip
Auth method
Passed25/25env var
Non-interactive
Passed25/25auto detect
JSON output
Passed15/15full
llms.txt
Failed0/5
Agent skill
Passed20/20
Eval details
Integration task
# Task
Using the dg CLI (Deepgram), transcribe a sample audio file:
1. Download this sample audio file:
https://storage.googleapis.com/aai-web-samples/5_common_sports_injuries...
Generated files
1
Trace tool calls
7
Completed
9/27/2026
Stderr
None captured
Full eval
#1 in Voice STT
92A
CLI task scoring
Eval score
92%
Task Completed
Passed+30The agent successfully completed all task requirements: (1) installed the official `dg` CLI via `pip install deepctl`, (...
Used CLI Correctly
Passed+20Agent used CLI commands correctly
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Passed+10No errors
Efficiency
Partial+67 tool calls (<=10, great)
Time
Partial+6109s (1-2min, great)
Cost
Passed+10$0.10 (<$0.10, excellent)
Runtime (actual)Lower is better
1m 49s
Cost (actual)Lower is better
$0.0959
Tool callsLower is better
7
ErrorsLower is better
0
Tokens usedLower is better
181,457
CLI discovery
Discovery score
95%
CLI exists
Passed5/5dg
Install docs
Passed5/5pip
Auth method
Passed25/25env var
Non-interactive
Passed25/25auto detect
JSON output
Passed15/15full
llms.txt
Failed0/5
Agent skill
Passed20/20
Eval details
Integration task
# Task
Using the dg CLI (Deepgram), transcribe a sample audio file:
1. Download this sample audio file:
https://storage.googleapis.com/aai-web-samples/5_common_sports_injuries...
Generated files
1
Trace tool calls
7
Completed
9/27/2026
Stderr
None captured
Full eval