Agentmail
All 1 ran the same Email task · Same Email task · View the taskView the task
CompanyClick a name to swap it
#1 in Email · #13 overall
84B
Compare up to 4. Next in Email:
MCP task scoring
Task score
88%
Task
Passed+30The agent successfully completed all required tasks using only Agentmail MCP tools. It discovered available tools, liste...
Used MCP Correctly
Passed+20Agent made 5 MCP tool calls
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Passed+10No errors
Efficiency
Partial+67 tool calls (<=10, great)
Time
Partial+2.0280s (3-5min, slow)
Cost
Passed+10$0.10 (<$0.10, excellent)
Runtime (actual)Lower is better
4m 39s
Cost (actual)Lower is better
$0.0965
Tool callsLower is better
7
ErrorsLower is better
0
Tokens usedLower is better
180,827
MCP discovery
Discovery score
75%
Official MCP
Passed5/5
Auth Method
Passed15/15env var
Tool Count
Partial3/1041 tools, heavy
Tool Description Length
Failed0/1013,234 tokens, bloated
llms.txt
Passed10/10
Output Schema
Failed0/5
Tool Stability
Passed5/5
Security Posture
Partial9/10No API keys or tokens are exposed in tool descriptions or schemas; parameters are clearly typed and validated; however,...
Tool API Mapping
Partial14/15Tools map cleanly 1:1 to individual API operations (create_inbox, get_message, list_threads, etc.), with rare exceptions...
Description Clarity
Partial14/15Descriptions are comprehensive and explain tool purpose, parameters, expected outcomes, and edge cases clearly; agents c...
Eval details
Integration task
# Task
Using the Agentmail MCP, perform email operations:
1. Discover available MCP tools and their capabilities
2. Create a new email inbox (or list available inboxes/domains)
3...
Generated files
1
Trace tool calls
7
Completed
10/14/2026
Stderr
None captured
Full eval
#1 in Email
84B
MCP task scoring
Task score
88%
Task
Passed+30The agent successfully completed all required tasks using only Agentmail MCP tools. It discovered available tools, liste...
Used MCP Correctly
Passed+20Agent made 5 MCP tool calls
Partial Credit
Passed+10Partial credit: 100%
Zero Errors
Passed+10No errors
Efficiency
Partial+67 tool calls (<=10, great)
Time
Partial+2.0280s (3-5min, slow)
Cost
Passed+10$0.10 (<$0.10, excellent)
Runtime (actual)Lower is better
4m 39s
Cost (actual)Lower is better
$0.0965
Tool callsLower is better
7
ErrorsLower is better
0
Tokens usedLower is better
180,827
MCP discovery
Discovery score
75%
Official MCP
Passed5/5
Auth Method
Passed15/15env var
Tool Count
Partial3/1041 tools, heavy
Tool Description Length
Failed0/1013,234 tokens, bloated
llms.txt
Passed10/10
Output Schema
Failed0/5
Tool Stability
Passed5/5
Security Posture
Partial9/10No API keys or tokens are exposed in tool descriptions or schemas; parameters are clearly typed and validated; however,...
Tool API Mapping
Partial14/15Tools map cleanly 1:1 to individual API operations (create_inbox, get_message, list_threads, etc.), with rare exceptions...
Description Clarity
Partial14/15Descriptions are comprehensive and explain tool purpose, parameters, expected outcomes, and edge cases clearly; agents c...
Eval details
Integration task
# Task
Using the Agentmail MCP, perform email operations:
1. Discover available MCP tools and their capabilities
2. Create a new email inbox (or list available inboxes/domains)
3...
Generated files
1
Trace tool calls
7
Completed
10/14/2026
Stderr
None captured
Full eval