Back to leaderboard

Supabase vs Clerk

Same Auth task · View

#1 in Auth

90ABest on 6 of 14

#3 in Auth

83BBest on 0 of 14

Agent performance

Eval score
86%
76%
Task success
Passed
Passed
Cost per runLower is better
$0.1593
$0.2521
Tool callsLower is better
9
11
ErrorsLower is better
0
2
RuntimeLower is better
1m 5s
1m 14s
Tokens usedLower is better
183,723
223,064

Discoverability

Discovery score
100%
100%
Context7
llms.txt
MCP Server
Typed SDK
OpenAPI
Agent Skills

Eval details

Integration task
# Task Using https://supabase.com/docs/reference/python/auth-*****-inviteuserbyemail, complete the following task: Using the Supabase Python SDK, build me a script that manages u...
# Task Using https://clerk.com/docs, complete the following task: Using the Clerk Python SDK, build me a script that manages user invitations via the API: 1. Install the officia...
Generated files
1
1
Trace tool calls
9
11
Completed
10/28/2026
9/23/2026
Stderr
None captured
None captured