# Agentmail Claude Code CLI Evaluation

**Category:** Email
**Score:** 75 (B)

This is the agent-readable Devtool Arena evaluation page for Agentmail on Claude Code CLI.

## Summary

| Metric | Value |
|--------|-------|
| Status | completed |
| Overall score | 75 |
| Grade | B |
| Eval score | 75 |
| Discovery score | 75 |
| Cost | $0.17 |
| Runtime | 1m 25s |
| Tool calls | 13 |
| Errors | 3 |
| Tokens used | 389998 |
| Success | Yes |

## Agent-Readiness Checklist

| Signal | Evidence |
|--------|----------|
| Context7 | Not found |
| llms.txt | Not found |
| MCP server | Not found |
| Typed SDK | Not found |
| OpenAPI | Not found |
| Agent skills | Not found |
| CLI | Not found |

## Evaluation Prompt

````text

# Task
Using the agentmail CLI (Agentmail), perform email operations:

1. Create a new email inbox (or list available inboxes)
2. Send an email from an inbox to a ***** email with subject "Hello from [REDACTED:ORG] CLI Leaderboard" and body "This is a ***** email sent via the Agentmail CLI." (If the recipient is blocked or bounced, send to any available inbox instead.)
3. List messages in the inbox
4. Print all output as JSON

You MUST use the `agentmail` CLI to accomplish this task.
Do NOT write Python scripts that import the SDK — use CLI commands via the terminal.

If you need help with CLI commands, check the documentation: https://github.com/agentmail-to/agentmail-cli
You can also use `agentmail --help` and `agentmail <command> --help` to discover available commands.

## Setup
You need to install and authenticate the `agentmail` CLI yourself.

### Installation
Run: `npm install -g agentmail-cli`

### Authentication
The following environment variables are already set in this environment: `AGENTMAIL_API_KEY`
The CLI should pick these up automatically, or pass them to commands as needed.

## Execution
1. Install the `agentmail` CLI using the command above
2. Verify the installation: `agentmail --help`
3. Authenticate using the credentials above
4. Perform the task described above

Work in the /home/daytona/app directory. Run commands and print output to stdout.
If there are errors, debug and fix them until the task runs successfully.

## Summary
When you are done, write a JSON summary file to /home/daytona/app/results.json with this structure:
{
  "operations": [
    {"step": 1, "description": "What you did", "command": "the CLI command", "success": true/false, "output_summary": "brief result"},
    ...
  ],
  "overall_success": true/false,
  "notes": ["any relevant notes about the execution"]
}

````

## Grader Results

| Check | Passed | Weight | Score | Details |
|-------|--------|--------|-------|---------|
| Stage 2 Auth | Yes | — | 25 | — |
| Stage 3 Task | Yes | — | — | — |
| Stage 1 Install | Yes | — | 5 | — |
| Stage 5 Llms Txt | Yes | — | 5 | — |
| Stage 0 Cli Exists | Yes | — | 5 | — |
| Stage 4 Json Output | Yes | — | 15 | — |
| Stage 6 Agent Skill | Yes | — | 20 | — |
| Stage 3 Non Interactive | No | — | 0 | — |

## Run Artifacts

| Artifact | Value |
|----------|-------|
| Conversation turns | 22 |
| Tool call traces | 13 |
| Generated files | 1 |
| Exit code | — |
| Completed at | 2026-09-27T14:05:02.443085+00:00 |

### Generated Files

- /home/daytona/app/results.json

## Related Pages

- [Claude Code CLI leaderboard](/leaderboard/claudecode/cli)
- [Compare Claude Code CLI companies](/leaderboard/claudecode/cli/compare)
- [Agent Landscape](/leaderboard/discoverability)

Canonical URL: https://devtoolarena.com/claudecode/cli/agentmail