Back to leaderboard

Prefect

Same Durable Workflow task · View

#1 in Durable Workflow

43D

MCP task scoring

Task score
24%
Task
Failed+0The agent correctly used MCP tools exclusively for product operations and successfully completed step 1 (discovery). How...
Used MCP Correctly
Passed+20Agent made 11 MCP tool calls
Partial Credit
Partial+2.5Partial credit: 25%
Zero Errors
Failed+0Failed tool calls: 10
Efficiency
Failed+044 tool calls (>25, inefficient)
Time
Partial+1.0509s (5-10min, very slow)
Cost
Partial+1.0$0.90 ($0.70-1.00, very expensive)
Runtime (actual)Lower is better
8m 29s
Cost (actual)Lower is better
$0.9015
Tool callsLower is better
44
ErrorsLower is better
10
Tokens usedLower is better
2,022,284

MCP discovery

Discovery score
89%
Official MCP
Passed5/5
Auth Method
Passed15/15env var
Tool Count
Passed10/1015 tools, lean
Tool Description Length
Partial7/104,185 tokens, moderate
llms.txt
Passed10/10
Output Schema
Failed0/5
Tool Stability
Passed5/5
Security Posture
Partial9/10No API keys or tokens in descriptions; workspace_id is properly typed as optional UUID; minor concern that workspace_id...
Tool API Mapping
Partial14/15Tools map cleanly to individual API read operations with minimal bundling; each tool performs one primary action (get, s...
Description Clarity
Partial14/15Descriptions are comprehensive and clear, explaining purpose, return values, filter operators, and providing multiple co...

Eval details

Integration task
# Task Using the Prefect MCP, interact with the workflow engine: 1. Discover available MCP tools and their capabilities 2. List existing workflow executions (or deployments/flows...
Generated files
1
Trace tool calls
44
Completed
10/4/2026
Stderr
None captured
Full eval