Back to leaderboard

Scalekit

Same Auth task · View

#5 in Auth

74C

Agent performance

Eval score
64%
Task success
Passed
Cost per runLower is better
$0.9843
Tool callsLower is better
38
ErrorsLower is better
8
RuntimeLower is better
4m 10s
Tokens usedLower is better
1,341,294

Discoverability

Discovery score
100%
Context7
llms.txt
MCP Server
Typed SDK
OpenAPI
Agent Skills

Eval details

Integration task
# Task Using https://docs.scalekit.com, complete the following task: Using the Scalekit Python SDK, build me a script that manages user invitations via the API: 1. Install the o...
Generated files
2
Trace tool calls
38
Completed
9/23/2026
Stderr
None captured
Full eval