WSO2 Asgardeo
34/ 100
DVerification failed
Score Breakdown34%
Lost points on 10 checks
- cost6/10
- time9/15
- efficiency1/10
- syntax valid0/5
- created files0/10
- full execution0/35
- Context70/14
- OpenAPI0/14
- Agent Skills0/14
- CLI0/14
Eval Score (70% weight)31%
cost$0.12 ($0.10–$0.20, great)+6
time70s (60s–120s, great)+9
efficiency24 tool calls (≤25, below average)+1
found docsTouched docs at wso2.com: yes (6 matching tool calls)+10
zero errorsNo errors in tool outputs+5
syntax validSyntax errors present+0
created filesGenerated files: 0 (need ≥1)+0
full executionMethod: failed, Exit: 1+0
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(31 × 0.7) + (43 × 0.3)= 34%
Replay
Using https://wso2.com/asgardeo/docs/apis/, complete the following task: Using the WSO2 Asgardeo Python SDK, build me a script that manages user invitations via the API: 1. Install the official WSO2 Asgardeo Python SDK (pip install) 2. Use the SDK to: a. Send an invitation to "leaderboard-*****@example.com" b. List all pending invitations and print them as JSON c. Revoke the invitation you just created 3. Print the result of each step clearly labeled (e.g., "=== INVITED ===", "=== PENDING ===", "=== REVOKED ===") You MUST use the official WSO2 Asgardeo Python SDK — do not construct OAuth URLs or make raw HTTP/REST calls.
stdout
Exit code: 1
Unlock analytics
See WSO2 Asgardeo's score trend, layer rankings, and competitive position.
Run completed Oct 26, 2026, 6:47 PM