# Scalekit Codex CLI Evaluation

**Category:** Auth
**Score:** 35 (D)

This is the agent-readable Devtool Arena evaluation page for Scalekit on Codex CLI.

## Summary

| Metric | Value |
|--------|-------|
| Status | completed |
| Overall score | 35 |
| Grade | D |
| Eval score | 37 |
| Discovery score | 33 |
| Cost | $0.22 |
| Runtime | 1m 53s |
| Tool calls | 25 |
| Errors | 4 |
| Tokens used | 889256 |
| Success | No |

## Agent-Readiness Checklist

| Signal | Evidence |
|--------|----------|
| Context7 | Not found |
| llms.txt | Not found |
| MCP server | Not found |
| Typed SDK | Not found |
| OpenAPI | Not found |
| Agent skills | Not found |
| CLI | Not found |

## Evaluation Prompt

````text

# Task
Using the @scalekit-sdk/dryrun CLI (Scalekit), ***** an SSO/OIDC authentication flow:

1. Run `npx @scalekit-sdk/dryrun` with the Scalekit environment credentials (SCALEKIT_ENV_URL, SCALEKIT_CLIENT_ID, SCALEKIT_CLIENT_SECRET are available as environment variables)
2. Observe the OIDC discovery and authentication setup output
3. Verify the tool obtains a valid OAuth access token
4. Use the obtained token or the CLI to list organizations via the Scalekit API
5. Print all output clearly labeled for each step

The dryrun CLI is designed to ***** SSO/OIDC authentication flows. Focus on running the dryrun simulation and verifying it produces valid auth tokens.

You MUST use the `npx @scalekit-sdk/dryrun` CLI to accomplish this task.
Do NOT write Python scripts that import the SDK — use CLI commands via the terminal.

If you need help with CLI commands, check the documentation: https://github.com/scalekit-inc/scalekit-dryrun
You can also use `npx @scalekit-sdk/dryrun --help` and `npx @scalekit-sdk/dryrun <command> --help` to discover available commands.

## Setup
You need to install and authenticate the `npx @scalekit-sdk/dryrun` CLI yourself.

### Installation
Run: `npm install -g @scalekit-sdk/dryrun`

### Authentication
Run: `npx @scalekit-sdk/dryrun --env_url {url} --client_id {id}`
Credentials are available as environment variables: `SCALEKIT_CLIENT_ID`, `SCALEKIT_CLIENT_SECRET`, `SCALEKIT_ENV_URL`

## Execution
1. Install the `npx @scalekit-sdk/dryrun` CLI using the command above
2. Verify the installation: `npx @scalekit-sdk/dryrun --help`
3. Authenticate using the credentials above
4. Perform the task described above

Work in the /home/daytona/app directory. Run commands and print output to stdout.
If there are errors, debug and fix them until the task runs successfully.

## Summary
When you are done, write a JSON summary file to /home/daytona/app/results.json with this structure:
{
  "operations": [
    {"step": 1, "description": "What you did", "command": "the CLI command", "success": true/false, "output_summary": "brief result"},
    ...
  ],
  "overall_success": true/false,
  "notes": ["any relevant notes about the execution"]
}

````

## Grader Results

| Check | Passed | Weight | Score | Details |
|-------|--------|--------|-------|---------|
| Stage 2 Auth | Yes | — | 3 | — |
| Stage 3 Task | No | — | — | — |
| Stage 1 Install | Yes | — | 5 | — |
| Stage 5 Llms Txt | No | — | 0 | — |
| Stage 0 Cli Exists | Yes | — | 5 | — |
| Stage 4 Json Output | No | — | 0 | — |
| Stage 6 Agent Skill | Yes | — | 20 | — |
| Stage 3 Non Interactive | No | — | 0 | — |

## Run Artifacts

| Artifact | Value |
|----------|-------|
| Conversation turns | 31 |
| Tool call traces | 25 |
| Generated files | 1 |
| Exit code | — |
| Completed at | 2026-09-27T14:34:50.007515+00:00 |

### Generated Files

- /home/daytona/app/results.json

## Related Pages

- [Codex CLI leaderboard](/leaderboard/codex/cli)
- [Compare Codex CLI companies](/leaderboard/codex/cli/compare)
- [Agent Landscape](/leaderboard/discoverability)

Canonical URL: https://devtoolarena.com/codex/cli/scalekit