Scalekit
79/ 100
BScore Breakdown79%
Lost points on 4 checks
- cost6/10
- time5/15
- efficiency0/10
- zero errors0/5
Eval Score (70% weight)71%
cost$0.18 ($0.10–$0.20, great)+6
time128s (120s–180s, good)+5
efficiency27 tool calls (>25, inefficient)+0
found docsTouched docs at docs.scalekit.com: yes (19 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 2+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(71 × 0.7) + (100 × 0.3)= 79%
Replay
Using https://docs.scalekit.com, complete the following task: Using the Scalekit Python SDK, build me a script that manages user invitations via the API: 1. Install the official Scalekit Python SDK (pip install) 2. Use the SDK to: a. Send an invitation to "leaderboard-*****@example.com" b. List all pending invitations and print them as JSON c. Revoke the invitation you just created 3. Print the result of each step clearly labeled (e.g., "=== INVITED ===", "=== PENDING ===", "=== REVOKED ===") You MUST use the official Scalekit Python SDK — do not construct OAuth URLs or make raw HTTP/REST calls.
manage_invitations.py
Unlock analytics
See Scalekit's score trend, layer rankings, and competitive position.
Run completed Oct 26, 2026, 6:41 PM