Scalekit vs Clerk
Both ran the same Auth task · Same Auth task · View the taskView the task
CompanyClick a name to swap it
#5 in Auth · #65 overall
74CBest on 0 of 14
#3 in Auth · #25 overall
83BBest on 6 of 14
Compare up to 4. Next in Auth:
Agent performance
Eval score
64%
76%
Task success
Passed
Passed
Cost per runLower is better
$0.9843
$0.2521
Tool callsLower is better
38
11
ErrorsLower is better
8
2
RuntimeLower is better
4m 10s
1m 14s
Tokens usedLower is better
1,341,294
223,064
Discoverability
Discovery score
100%
100%
Eval details
Integration task
# Task
Using https://docs.scalekit.com, complete the following task:
Using the Scalekit Python SDK, build me a script that manages user invitations via the API:
1. Install the o...
# Task
Using https://clerk.com/docs, complete the following task:
Using the Clerk Python SDK, build me a script that manages user invitations via the API:
1. Install the officia...
Generated files
2
1
Trace tool calls
38
11
Completed
9/23/2026
9/23/2026
Stderr
None captured
None captured
#5 in Auth
74CBest on 0 of 14
#3 in Auth
83BBest on 6 of 14
Agent performance
Eval score
64%
76%
Task success
Passed
Passed
Cost per runLower is better
$0.9843
$0.2521
Tool callsLower is better
38
11
ErrorsLower is better
8
2
RuntimeLower is better
4m 10s
1m 14s
Tokens usedLower is better
1,341,294
223,064
Discoverability
Discovery score
100%
100%
Eval details
Integration task
# Task
Using https://docs.scalekit.com, complete the following task:
Using the Scalekit Python SDK, build me a script that manages user invitations via the API:
1. Install the o...
# Task
Using https://clerk.com/docs, complete the following task:
Using the Clerk Python SDK, build me a script that manages user invitations via the API:
1. Install the officia...
Generated files
2
1
Trace tool calls
38
11
Completed
9/23/2026
9/23/2026
Stderr
None captured
None captured
Full eval