# Shopware Grok API Evaluation

**Category:** CMS
**Score:** 75 (B)

This is the agent-readable Devtool Arena evaluation page for Shopware on Grok API.

## Summary

| Metric | Value |
|--------|-------|
| Status | completed |
| Overall score | 75 |
| Grade | B |
| Eval score | 65 |
| Discovery score | 100 |
| Cost | $1.64 |
| Runtime | 14m 7s |
| Tool calls | 33 |
| Errors | 0 |
| Tokens used | 1245552 |
| Success | Yes |

## Agent-Readiness Checklist

| Signal | Evidence |
|--------|----------|
| Context7 | https://context7.com/shopware/shopware |
| llms.txt | https://developer.shopware.com/llms.txt |
| MCP server | https://github.com/shopware/shopware-admin-mcp |
| Typed SDK | https://github.com/shopware/frontends |
| OpenAPI | https://github.com/shopware/store-api-reference |
| Agent skills | https://github.com/shopwareLabs/ai-coding-tools |
| CLI | https://github.com/shopware/shopware-cli |

## Evaluation Prompt

````text

# Task
Using https://developer.shopware.com/[REDACTED:TENANT]/guides/development/integrations-api/, complete the following task:

Using the Shopware Python SDK, build me a script that manages CMS content:

1. Install the official Shopware Python SDK (pip install)
2. Connect to the Shopware instance
3. List available content types
4. Create a new content entry of type "article" (or the first available type) with title "[REDACTED:ORG] Leaderboard Test" and body "This is a ***** article created via the Shopware API."
5. Fetch the created entry back and print it as JSON
6. List all entries of that content type

Print all output clearly labeled for each step.

You MUST use the official Shopware Python SDK — do not make raw HTTP/REST calls. 

## Execution
After creating the script, run it to verify it works:
```bash
cd /home/daytona/app && python <your_script>.py
```

The script should print output to stdout. If there are errors, debug and fix them until it runs successfully.

````

## Grader Results

| Check | Passed | Weight | Score | Details |
|-------|--------|--------|-------|---------|
| Cost | No | 0 | 0 | $1.64 (≥$1.00, too expensive) |
| Time | No | 0 | 0 | 847s (≥10min, too slow) |
| Efficiency | No | 0 | 0 | 33 tool calls (>25, inefficient) |
| Found Docs | Yes | 0 | — | Touched [REDACTED:TENANT] at developer.shopware.com: yes (9 matching tool calls) |
| Zero Errors | Yes | 0 | — | No errors in tool outputs |
| Syntax Valid | Yes | 0 | — | Code compiles/parses correctly |
| Created Files | Yes | 0 | — | Generated files: 1 (need ≥1) |
| Full Execution | Yes | 0 | — | Method: full_execution, Exit: 0 |

## Run Artifacts

| Artifact | Value |
|----------|-------|
| Conversation turns | 34 |
| Tool call traces | 33 |
| Generated files | 1 |
| Exit code | 0 |
| Completed at | 2026-10-19T17:23:51.977399+00:00 |

### Generated Files

- /home/daytona/app/cms_content_manager.py

## Related Pages

- [Grok API leaderboard](/grok/api)
- [Compare Grok API companies](/grok/api/compare)
- [Agent Landscape](/discoverability)

Canonical URL: https://devtoolarena.com/grok/api/shopware