Stytch
74/ 100
CScore Breakdown74%
Lost points on 5 checks
- time5/15
- efficiency2/10
- OpenAPI0/14
- Agent Skills0/14
- CLI0/14
Eval Score (70% weight)82%
cost$0.01 (<$0.05, excellent)+10
time76s (60s–90s, good)+5
efficiency17 tool calls (≤20, acceptable)+2
found docsTouched docs at stytch.com: yes (8 matching tool calls)+10
zero errorsNo errors in tool outputs+5
syntax validCode compiles/parses correctly+5
created filesGenerated files: 2 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(82 × 0.7) + (57 × 0.3)= 74%
Replay
Using https://stytch.com/docs, complete the following task: Using the Stytch Python SDK, build me a script that manages user invitations via the API: 1. Install the official Stytch Python SDK (pip install) 2. Use the SDK to: a. Send an invitation to "[REDACTED:EMAIL]" b. List all pending invitations and print them as JSON c. Revoke the invitation you just created 3. Print the result of each step clearly labeled (e.g., "=== INVITED ===", "=== PENDING ===", "=== REVOKED ===") You MUST use the official Stytch Python SDK — do not construct OAuth URLs or make raw HTTP/REST calls.
opencode.json
Unlock analytics
See Stytch's score trend, layer rankings, and competitive position.
Run completed Oct 23, 2026, 7:05 AM