# Convex Muse API Evaluation

**Category:** Database
**Score:** 71 (C)

This is the agent-readable Devtool Arena evaluation page for Convex on Muse API.

## Summary

| Metric | Value |
|--------|-------|
| Status | completed |
| Overall score | 71 |
| Grade | C |
| Eval score | 65 |
| Discovery score | 86 |
| Cost | $0.57 |
| Runtime | 4m 55s |
| Tool calls | 40 |
| Errors | 4 |
| Tokens used | 2853710 |
| Success | Yes |

## Agent-Readiness Checklist

| Signal | Evidence |
|--------|----------|
| Context7 | https://context7.com/get-convex/convex-js |
| llms.txt | https://convex.dev/llms.txt |
| MCP server | https://docs.convex.dev/ai/convex-mcp-server |
| Typed SDK | https://registry.npmjs.org/convex |
| OpenAPI | Not found |
| Agent skills | https://github.com/get-convex/agent-skills |
| CLI | https://docs.convex.dev/cli/overview |

## Evaluation Prompt

````text

# Task
Using https://docs.convex.dev, complete the following task:

Using the Convex Python SDK, build me a script that performs CRUD operations:

1. Install the official Convex Python SDK (pip install)
2. Connect to Convex using the SDK
3. Create a table/collection called "leaderboard_*****" with fields: id, name (string), score (number), created_at (timestamp)
4. Insert 3 records: ("Alice", 95), ("Bob", 87), ("Charlie", 92)
5. Query all records sorted by score descending
6. Update Bob's score to 91
7. Delete Charlie's record
8. Query again and print the final state as JSON

You MUST use the official Convex Python SDK — do not make raw HTTP/REST calls. 

## Execution
After creating the script, run it to verify it works:
```bash
cd /home/daytona/app && python <your_script>.py
```

The script should print output to stdout. If there are errors, debug and fix them until it runs successfully.

````

## Grader Results

| Check | Passed | Weight | Score | Details |
|-------|--------|--------|-------|---------|
| Cost | No | 0 | 0 | $0.57 ($0.40–0.70, expensive) |
| Time | No | 0 | 0 | 295s (3–5min, slow) |
| Efficiency | No | 0 | 0 | 40 tool calls (>25, inefficient) |
| Found Docs | Yes | 0 | — | Touched docs at docs.convex.dev: yes (9 matching tool calls) |
| Zero Errors | No | 0 | — | Tool outputs with errors/tracebacks: 4 |
| Syntax Valid | Yes | 0 | — | Code compiles/parses correctly |
| Created Files | Yes | 0 | — | Generated files: 11 (need ≥1) |
| Full Execution | Yes | 0 | — | Method: full_execution, Exit: 0 |

## Run Artifacts

| Artifact | Value |
|----------|-------|
| Conversation turns | 41 |
| Tool call traces | 40 |
| Generated files | 11 |
| Exit code | 0 |
| Completed at | 2026-10-15T15:01:51.685381+00:00 |

### Generated Files

- /home/daytona/app/main.py
- /home/daytona/app/package.json
- /home/daytona/app/convex/schema.ts
- /home/daytona/app/requirements.txt
- /home/daytona/app/package-lock.json
- /home/daytona/app/convex/_generated/api.js
- /home/daytona/app/convex/_generated/api.d.ts
- /home/daytona/app/convex/_generated/server.js
- /home/daytona/app/convex/leaderboard_*****.ts
- /home/daytona/app/convex/_generated/server.d.ts
- /home/daytona/app/convex/_generated/dataModel.d.ts

## Related Pages

- [Muse API leaderboard](/leaderboard/muse/api)
- [Compare Muse API companies](/leaderboard/muse/api/compare)
- [Agent Landscape](/leaderboard/discoverability)

Canonical URL: https://devtoolarena.com/muse/api/convex