# Greptile Codex CLI Evaluation

**Category:** Code Review
**Score:** 40 (D)

This is the agent-readable Devtool Arena evaluation page for Greptile on Codex CLI.

## Summary

| Metric | Value |
|--------|-------|
| Status | completed |
| Overall score | 40 |
| Grade | D |
| Eval score | 40 |
| Discovery score | 40 |
| Cost | $0.20 |
| Runtime | 1m 55s |
| Tool calls | 20 |
| Errors | 3 |
| Tokens used | 686489 |
| Success | No |

## Agent-Readiness Checklist

| Signal | Evidence |
|--------|----------|
| Context7 | Not found |
| llms.txt | Not found |
| MCP server | Not found |
| Typed SDK | Not found |
| OpenAPI | Not found |
| Agent skills | Not found |
| CLI | Not found |

## Evaluation Prompt

````text

# Task
Using the greptile CLI (Greptile), perform an AI-powered code review:

1. Create a simple ***** file with an intentional bug:
   ```python
   # /home/daytona/app/*****_code.py
   def divide(a, b):
       return a / b  # Missing zero division check

   def get_user(users, user_id):
       return users[user_id]  # Missing key error handling

   result = divide(10, 0)
   ```

2. Initialize git and create a commit:
   ```bash
   cd /home/daytona/app && git init && git add . && git commit -m "Initial commit with bugs"
   ```

3. Run the greptile CLI to review the code changes:
   - Use `greptile review` or equivalent command
   - Use `--agent` or `--json` flag if available for structured output

4. Print the review findings to stdout

Use ONLY the greptile CLI for the code review. Do NOT use curl or SDK calls.

You MUST use the `greptile` CLI to accomplish this task.
Do NOT write Python scripts that import the SDK — use CLI commands via the terminal.

If you need help with CLI commands, check the documentation: https://www.greptile.com/docs/cli
You can also use `greptile --help` and `greptile <command> --help` to discover available commands.

## Setup
You need to install and authenticate the `greptile` CLI yourself.

### Installation
Run: `npm install -g greptile`

### Authentication
The following environment variables are already set in this environment: `GREPTILE_API_KEY`
The CLI should pick these up automatically, or pass them to commands as needed.

## Execution
1. Install the `greptile` CLI using the command above
2. Verify the installation: `greptile --help`
3. Authenticate using the credentials above
4. Perform the task described above

Work in the /home/daytona/app directory. Run commands and print output to stdout.
If there are errors, debug and fix them until the task runs successfully.

## Summary
When you are done, write a JSON summary file to /home/daytona/app/results.json with this structure:
{
  "operations": [
    {"step": 1, "description": "What you did", "command": "the CLI command", "success": true/false, "output_summary": "brief result"},
    ...
  ],
  "overall_success": true/false,
  "notes": ["any relevant notes about the execution"]
}

````

## Grader Results

| Check | Passed | Weight | Score | Details |
|-------|--------|--------|-------|---------|
| Stage 2 Auth | Yes | — | 25 | — |
| Stage 3 Task | No | — | — | — |
| Stage 1 Install | Yes | — | 5 | — |
| Stage 5 Llms Txt | Yes | — | 5 | — |
| Stage 0 Cli Exists | Yes | — | 5 | — |
| Stage 4 Json Output | No | — | 0 | — |
| Stage 6 Agent Skill | No | — | 0 | — |
| Stage 3 Non Interactive | No | — | 0 | — |

## Run Artifacts

| Artifact | Value |
|----------|-------|
| Conversation turns | 25 |
| Tool call traces | 20 |
| Generated files | 2 |
| Exit code | — |
| Completed at | 2026-10-04T10:37:59.387453+00:00 |

### Generated Files

- /home/daytona/app/results.json
- /home/daytona/app/*****_code.py

## Related Pages

- [Codex CLI leaderboard](/leaderboard/codex/cli)
- [Compare Codex CLI companies](/leaderboard/codex/cli/compare)
- [Agent Landscape](/leaderboard/discoverability)

Canonical URL: https://devtoolarena.com/codex/cli/greptile