Agentmail
87/ 100
BScore Breakdown87%
Lost points on 3 checks
- time9/15
- efficiency3/10
- zero errors0/5
Eval Score (70% weight)82%
cost$0.00 (<$0.05, excellent)+10
time58s (30s–60s, great)+9
efficiency14 tool calls (≤15, good)+3
found docsTouched docs at docs.agentmail.to: yes (3 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 1+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(82 × 0.7) + (100 × 0.3)= 87%
Replay
Using https://docs.agentmail.to, complete the following task: Using Agentmail, build me a script that: 1. Create a new email inbox 2. Send an email from that inbox to "[REDACTED:EMAIL]" with subject "Hello from [REDACTED:ORG] Leaderboard" and body "This is a ***** email sent via Agentmail." 3. List all messages in the inbox 4. Print the inbox details, sent message status, and message list as JSON
agentmail_inbox_manager.py
Unlock analytics
See Agentmail's score trend, layer rankings, and competitive position.
Run completed Oct 20, 2026, 8:10 PM