Agentmail

Agentmail

agentmail.toEmailHermesHermes
89/ 100
B
Score Breakdown89%

Lost points on 3 checks

  • time9/15
  • efficiency6/10
  • zero errors0/5
Eval Score (70% weight)85%
cost$0.00 (<$0.05, excellent)+10
time46s (30s–60s, great)+9
efficiency9 tool calls (≤10, great)+6
found docsTouched docs at docs.agentmail.to: yes (4 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 1+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Checklist Score (30% weight)100%
Context7
Link+14
llms.txt
Link+14
MCP Server
Link+14
Typed SDK
Link+14
OpenAPI
Link+14
Agent Skills
Link+14
CLI
Link+14

Checklist determined by AI. If something looks wrong, .

Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(85 × 0.7) + (100 × 0.3)= 89%
Replay
Using https://docs.agentmail.to, complete the following task:

Using Agentmail, build me a script that:

1. Create a new email inbox
2. Send an email from that inbox to "[REDACTED:EMAIL]" with subject "Hello from [REDACTED:ORG] Leaderboard" and body "This is a ***** email sent via Agentmail."
3. List all messages in the inbox
4. Print the inbox details, sent message status, and message list as JSON
inbox_manager.py

Unlock analytics

See Agentmail's score trend, layer rankings, and competitive position.

Run completed Oct 25, 2026, 11:00 PM