Supabase vs Clerk
Both ran the same Auth task · Same Auth task · View the taskView the task
CompanyClick a name to swap it
#1 in Auth · #2 overall
90ABest on 6 of 14
#3 in Auth · #25 overall
83BBest on 0 of 14
Compare up to 4. Next in Auth:
Agent performance
Eval score
86%
76%
Task success
Passed
Passed
Cost per runLower is better
$0.1593
$0.2521
Tool callsLower is better
9
11
ErrorsLower is better
0
2
RuntimeLower is better
1m 5s
1m 14s
Tokens usedLower is better
183,723
223,064
Discoverability
Discovery score
100%
100%
Eval details
Integration task
# Task
Using https://supabase.com/docs/reference/python/auth-*****-inviteuserbyemail, complete the following task:
Using the Supabase Python SDK, build me a script that manages u...
# Task
Using https://clerk.com/docs, complete the following task:
Using the Clerk Python SDK, build me a script that manages user invitations via the API:
1. Install the officia...
Generated files
1
1
Trace tool calls
9
11
Completed
10/28/2026
9/23/2026
Stderr
None captured
None captured
#1 in Auth
90ABest on 6 of 14
#3 in Auth
83BBest on 0 of 14
Agent performance
Eval score
86%
76%
Task success
Passed
Passed
Cost per runLower is better
$0.1593
$0.2521
Tool callsLower is better
9
11
ErrorsLower is better
0
2
RuntimeLower is better
1m 5s
1m 14s
Tokens usedLower is better
183,723
223,064
Discoverability
Discovery score
100%
100%
Eval details
Integration task
# Task
Using https://supabase.com/docs/reference/python/auth-*****-inviteuserbyemail, complete the following task:
Using the Supabase Python SDK, build me a script that manages u...
# Task
Using https://clerk.com/docs, complete the following task:
Using the Clerk Python SDK, build me a script that manages user invitations via the API:
1. Install the officia...
Generated files
1
1
Trace tool calls
9
11
Completed
10/28/2026
9/23/2026
Stderr
None captured
None captured
Full eval