Get notified
Azion

Azion

azion.comCloud HostingCLI E2EClaude CodeClaude Code
38/ 100
D
Task failed
Error: Claude Code returned an error result: Reached maximum number of turns (60) (exit code: 1)
Score Breakdown38%

Lost points on 6 checks

  • cost0/10
  • time0/10
  • efficiency0/10
  • zero errors0/10
  • partial credit3/10
  • task completed0/30
Task Score (70% weight)23%

The agent successfully used the official azion CLI, cloned the repository, and attempted deployment multiple times. However, the deployment never completed successfully. The CLI consistently returned 'Error: Failed to capture deploy logs: Error while executing deploy command' despite creating applications and storage buckets. The agent never obtained a live deployment URL as required. After multiple failed attempts with the 'nextjs' preset (which turned out to be invalid and was corrected to 'next'), the agent switched to an 'html' preset at the end but the trace cuts off before confirming success. The core issue appears to be that while the CLI commands were correctly structured and the application was technically being created on the Azion platform, the deployment process itself was failing silently. No final deployment URL was ever printed to stdout.

Credit: 35%Confidence: 85%
Deductions:
  • Repository was cloned successfully but deployment never completed with a working URL
  • Initial preset 'nextjs' was invalid; should have been 'next' - caused early failures
  • Multiple deployment attempts failed with 'Failed to capture deploy logs' error despite CLI being used correctly
  • Agent deleted and recreated applications multiple times due to failures, indicating instability
  • Task requirement #4 (Print live deployment URL to stdout) was never accomplished
  • Final attempt switched to 'html' preset but trace cuts off before confirmation of success
  • No evidence of a working, accessible deployment URL in the output
Task Completed30%The agent successfully used the official azion CLI, cloned the repository, and attempted deployment multiple times. However, the deployment never completed successfully. The CLI consistently return...+0
Used CLI Correctly20%Agent used CLI commands correctly+20
Partial Credit10%Partial credit: 35%+3
Zero Errors10%Failed tool calls: 10+0
Efficiency10%69 tool calls (>25, inefficient)+0
Time10%1096s (≥600s, too slow)+0
Cost10%$1.22 (≥$1.00, too expensive)+0
0 + 20 + 3.5 + 0 + 0 + 0 + 0= 24%
CLI Checklist (30% weight)73%
CLI existsazion+5
Install docscurl script+5
Auth methodapi key cmd+25
Non-interactiveflag+18
JSON outputfull+15
llms.txt+5
Agent skill+0

env_var auth + non-interactive + JSON output = best, browser-only auth = poor

Final Score
(23 x 0.7) + (73 x 0.3)= 38%
Replay
Using the azion CLI (Azion), deploy this application https://github.com/seanflyyy/nextjs-starter to Azion:

1. Clone the repository: `git clone https://github.com/seanflyyy/nextjs-starter`
2. Deploy it using the azion CLI's deploy command
3. Wait for deployment to complete
4. Print the live deployment URL to stdout

The deployed app should be accessible at the printed URL.

You MUST use the `azion` CLI to accomplish this task.
Do NOT write Python scripts that import the SDK — use CLI commands via the terminal.

If you need help with CLI commands, check the documentation: https://www.azion.com/en/documentation/devtools/cli/
You can also use `azion --help` and `azion <command> --help` to discover available commands.

## Setup
You need to install and authenticate the `azion` CLI yourself.

### Installation
Run: `curl -fsSL https://cli.azion.app/install.sh | bash`

### Authentication
Run: `azion -t "$AZION_TOKEN"`
Credentials are available as environment variables: `AZION_TOKEN`

## Summary
When you are done, write a JSON summary file to results.json with this structure:
{
  "operations": [
    {"step": 1, "description": "What you did", "command": "the CLI command", "success": true/false, "output_summary": "brief result"},
    ...
  ],
  "overall_success": true/false,
  "notes": ["any relevant notes about the execution"]
}

Unlock analytics

See Azion's score trend, layer rankings, and competitive position.

Run completed Oct 29, 2026, 2:02 AM