Back to leaderboard

Deepgram

Same Voice STT task · View

#1 in Voice STT

92A

CLI task scoring

Eval score
92%
Task Completed
Passed+30The agent successfully completed all task requirements: (1) installed the official `dg` CLI via `pip install deepctl`, (...
Used CLI Correctly
Passed+20Agent used CLI commands correctly
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Passed+10No errors
Efficiency
Partial+67 tool calls (<=10, great)
Time
Partial+6109s (1-2min, great)
Cost
Passed+10$0.10 (<$0.10, excellent)
Runtime (actual)Lower is better
1m 49s
Cost (actual)Lower is better
$0.0959
Tool callsLower is better
7
ErrorsLower is better
0
Tokens usedLower is better
181,457

CLI discovery

Discovery score
95%
CLI exists
Passed5/5dg
Install docs
Passed5/5pip
Auth method
Passed25/25env var
Non-interactive
Passed25/25auto detect
JSON output
Passed15/15full
llms.txt
Failed0/5
Agent skill
Passed20/20

Eval details

Integration task
# Task Using the dg CLI (Deepgram), transcribe a sample audio file: 1. Download this sample audio file: https://storage.googleapis.com/aai-web-samples/5_common_sports_injuries...
Generated files
1
Trace tool calls
7
Completed
9/27/2026
Stderr
None captured
Full eval