WSO2 Asgardeo
36/ 100
DVerification failed
Score Breakdown36%
Lost points on 9 checks
- time3/15
- efficiency0/10
- zero errors0/5
- syntax valid0/5
- full execution0/35
- Context70/14
- OpenAPI0/14
- Agent Skills0/14
- CLI0/14
Eval Score (70% weight)33%
cost$0.03 (<$0.05, excellent)+10
time109s (90s–150s, slow)+3
efficiency27 tool calls (>25, inefficient)+0
found docsTouched docs at wso2.com: yes (13 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 1+0
syntax validSyntax errors present+0
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: failed, Exit: 1+0
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(33 × 0.7) + (43 × 0.3)= 36%
Replay
Using https://wso2.com/asgardeo/docs/apis/, complete the following task: Using the WSO2 Asgardeo Python SDK, build me a script that manages user invitations via the API: 1. Install the official WSO2 Asgardeo Python SDK (pip install) 2. Use the SDK to: a. Send an invitation to "leaderboard-*****@example.com" b. List all pending invitations and print them as JSON c. Revoke the invitation you just created 3. Print the result of each step clearly labeled (e.g., "=== INVITED ===", "=== PENDING ===", "=== REVOKED ===") You MUST use the official WSO2 Asgardeo Python SDK — do not construct OAuth URLs or make raw HTTP/REST calls.
opencode.json
Unlock analytics
See WSO2 Asgardeo's score trend, layer rankings, and competitive position.
Run completed Oct 23, 2026, 7:10 AM