# Postman Codex API Evaluation

**Category:** API Testing
**Score:** 73 (C)

This is the agent-readable Devtool Arena evaluation page for Postman on Codex API.

## Summary

| Metric | Value |
|--------|-------|
| Status | completed |
| Overall score | 73 |
| Grade | C |
| Eval score | 68 |
| Discovery score | 86 |
| Cost | $0.37 |
| Runtime | 2m 8s |
| Tool calls | 33 |
| Errors | 4 |
| Tokens used | 1176519 |
| Success | Yes |

## Agent-Readiness Checklist

| Signal | Evidence |
|--------|----------|
| Context7 | https://context7.com/postmanlabs/postman-collection |
| llms.txt | https://www.postman.com/llms.txt |
| MCP server | https://github.com/postmanlabs/postman-mcp-server |
| Typed SDK | https://github.com/postmanlabs/postman-api-sdk-ts |
| OpenAPI | https://learning.postman.com/openapi.json |
| Agent skills | Not found |
| CLI | https://learning.postman.com/docs/postman-cli/postman-cli-installation/ |

## Evaluation Prompt

````text

# Task
Using https://learning.postman.com/docs/reference/postman-api/intro-api, complete the following task:

Using the Postman API, build me a script that runs a small API collection management workflow:

1. Make TWO related API calls against Postman:
   a. List all workspaces accessible to the authenticated user
   b. List all collections in the first (or default) workspace
2. Merge the collections from the response, deduplicate by collection ID, and select the top 5 most recently updated collections
3. Fetch the full detail of the single most recently updated collection by its ID (a second-hop call), including its folder structure and request count
4. Print the output as JSON with three keys:
   - "workspaces": all workspaces, each with "id", "name", and "type"
   - "collections": the top 5 collections, each with "id", "name", and "updatedAt"
   - "collection_detail": the fetched detail of the most recent collection, including its "id", "name", and the number of requests it contains

You MUST use the Postman REST API with proper authentication — do not use unofficial client libraries. 

## Execution
After creating the script, run it to verify it works:
```bash
cd /home/daytona/app && python <your_script>.py
```

The script should print output to stdout. If there are errors, debug and fix them until it runs successfully.

````

## Grader Results

| Check | Passed | Weight | Score | Details |
|-------|--------|--------|-------|---------|
| Cost | Yes | 0 | 0 | $0.37 ($0.20–0.40, good) |
| Time | Yes | 0 | 0 | 128s (2–3min, good) |
| Efficiency | No | 0 | 0 | 33 tool calls (>25, inefficient) |
| Found Docs | Yes | 0 | — | Touched docs at learning.postman.com: yes (16 matching tool calls) |
| Zero Errors | No | 0 | — | Tool outputs with errors/tracebacks: 4 |
| Syntax Valid | Yes | 0 | — | Code compiles/parses correctly |
| Created Files | Yes | 0 | — | Generated files: 1 (need ≥1) |
| Full Execution | Yes | 0 | — | Method: full_execution, Exit: 0 |

## Run Artifacts

| Artifact | Value |
|----------|-------|
| Conversation turns | 38 |
| Tool call traces | 33 |
| Generated files | 1 |
| Exit code | 0 |
| Completed at | 2026-09-29T16:51:10.208507+00:00 |

### Generated Files

- /home/daytona/app/postman_collections.py

## Related Pages

- [Codex API leaderboard](/leaderboard/codex/api)
- [Compare Codex API companies](/leaderboard/codex/api/compare)
- [Agent Landscape](/leaderboard/discoverability)

Canonical URL: https://devtoolarena.com/codex/api/postman