Back to leaderboard

Telnyx

Same Voice Telephony task · View

#2 in Voice Telephony

44D

MCP task scoring

Task score
38%
Task
Failed+0The agent correctly used MCP tools exclusively for all operations and successfully discovered available resources and cr...
Used MCP Correctly
Passed+20Agent made 8 MCP tool calls
Partial Credit
Partial+6.5Partial credit: 65%
Zero Errors
Failed+0Failed tool calls: 2
Efficiency
Partial+3.511 tool calls (<=15, good)
Time
Partial+2.0223s (3-5min, slow)
Cost
Partial+6$0.14 ($0.10-0.20, great)
Runtime (actual)Lower is better
3m 43s
Cost (actual)Lower is better
$0.1392
Tool callsLower is better
11
ErrorsLower is better
2
Tokens usedLower is better
250,957

MCP discovery

Discovery score
61%
Official MCP
Passed5/5
Auth Method
Passed15/15env var
Tool Count
Partial3/1046 tools, heavy
Tool Description Length
Partial4/108,795 tokens, heavy
llms.txt
Failed0/10
Output Schema
Failed0/5
Tool Stability
Passed5/5
Security Posture
Partial8/10No obvious API keys or tokens in descriptions, but security concerns include: create_integration_secret and update_assis...
Tool API Mapping
Partial10/1515-20% of tools wrap workflows; 30-40% use opaque 'request' objects that obscure the actual API surface - Most tools map...
Description Clarity
Partial11/15Most tools have clear descriptions explaining purpose and parameters, but some lack detail on edge cases, return value s...

Eval details

Integration task
# Task Using the Telnyx MCP, perform a voice telephony task. 1. Discover available MCP tools and their capabilities **Preferred:** Create a ***** outbound voice call using the M...
Generated files
1
Trace tool calls
11
Completed
10/4/2026
Stderr
None captured
Full eval