Back to leaderboard

Okta vs Clerk

Same Auth task · View

#7 in Auth

66CBest on 1 of 14

#3 in Auth

83BBest on 7 of 14

Agent performance

Eval score
64%
76%
Task success
Passed
Passed
Cost per runLower is better
$0.7571
$0.2521
Tool callsLower is better
51
11
ErrorsLower is better
1
2
RuntimeLower is better
4m 57s
1m 14s
Tokens usedLower is better
1,831,715
223,064

Discoverability

Discovery score
71%
100%
Context7
llms.txt
MCP Server
Typed SDK
OpenAPI
Not found
Agent Skills
Not found

Eval details

Integration task
# Task Using https://developer.okta.com/docs/api/openapi/okta-management/management/tag/User/, complete the following task: Using the Okta Python SDK, build me a script that mana...
# Task Using https://clerk.com/docs, complete the following task: Using the Clerk Python SDK, build me a script that manages user invitations via the API: 1. Install the officia...
Generated files
5
1
Trace tool calls
51
11
Completed
10/28/2026
9/23/2026
Stderr
None captured
None captured