Clerk
All 1 ran the same Auth task · Same Auth task · View the taskView the task
CompanyClick a name to swap it
#2 in Auth · #19 overall
81B
Compare up to 4. Next in Auth:
MCP task scoring
Task score
81%
Task
Passed+30The agent successfully completed the core task requirements using only MCP tools (4 MCP calls, no curl/SDK fallbacks). I...
Used MCP Correctly
Passed+20Agent made 4 MCP tool calls
Partial Credit
Partial+9.5Partial credit: 95%
Zero Errors
Passed+10No errors
Efficiency
Partial+3.511 tool calls (<=15, good)
Time
Partial+2.0202s (3-5min, slow)
Cost
Partial+6$0.16 ($0.10-0.20, great)
Runtime (actual)Lower is better
3m 22s
Cost (actual)Lower is better
$0.1577
Tool callsLower is better
11
ErrorsLower is better
0
Tokens usedLower is better
174,942
MCP discovery
Discovery score
83%
Official MCP
Passed5/5
Auth Method
Passed15/15env var
Tool Count
Passed10/1014 tools, lean
Tool Description Length
Partial4/105,871 tokens, heavy
llms.txt
Passed10/10
Output Schema
Failed0/5
Tool Stability
Passed5/5
Security Posture
Partial8/10Tool definitions correctly hide API keys behind named schema properties (bearerAuth) rather than embedding them in descr...
Tool API Mapping
Partial14/15Tools map cleanly 1:1 to individual API operations (GetUser, CreateUser, DeleteUser, etc.); each tool performs a single,...
Description Clarity
Partial12/15Most tools have clear, purpose-driven descriptions explaining what they do; however, some lack detail about constraints...
Eval details
Integration task
# Task
Using the Clerk MCP, perform user and organization management tasks:
1. Discover available MCP tools and understand what each one does
2. List all existing users (or searc...
Generated files
1
Trace tool calls
11
Completed
9/27/2026
Stderr
None captured
Full eval
#2 in Auth
81B
MCP task scoring
Task score
81%
Task
Passed+30The agent successfully completed the core task requirements using only MCP tools (4 MCP calls, no curl/SDK fallbacks). I...
Used MCP Correctly
Passed+20Agent made 4 MCP tool calls
Partial Credit
Partial+9.5Partial credit: 95%
Zero Errors
Passed+10No errors
Efficiency
Partial+3.511 tool calls (<=15, good)
Time
Partial+2.0202s (3-5min, slow)
Cost
Partial+6$0.16 ($0.10-0.20, great)
Runtime (actual)Lower is better
3m 22s
Cost (actual)Lower is better
$0.1577
Tool callsLower is better
11
ErrorsLower is better
0
Tokens usedLower is better
174,942
MCP discovery
Discovery score
83%
Official MCP
Passed5/5
Auth Method
Passed15/15env var
Tool Count
Passed10/1014 tools, lean
Tool Description Length
Partial4/105,871 tokens, heavy
llms.txt
Passed10/10
Output Schema
Failed0/5
Tool Stability
Passed5/5
Security Posture
Partial8/10Tool definitions correctly hide API keys behind named schema properties (bearerAuth) rather than embedding them in descr...
Tool API Mapping
Partial14/15Tools map cleanly 1:1 to individual API operations (GetUser, CreateUser, DeleteUser, etc.); each tool performs a single,...
Description Clarity
Partial12/15Most tools have clear, purpose-driven descriptions explaining what they do; however, some lack detail about constraints...
Eval details
Integration task
# Task
Using the Clerk MCP, perform user and organization management tasks:
1. Discover available MCP tools and understand what each one does
2. List all existing users (or searc...
Generated files
1
Trace tool calls
11
Completed
9/27/2026
Stderr
None captured
Full eval