Latest results
Oct 2026 vs May 2026
Biggest improvements
Points gained since the May 2026 run
- +57Cloudflare
- +48Naive
- +45Netlify
- +40Zilliz Cloud
- +27Razorpay
- +24Qdrant
- +22Pinecone
- +21LiveKit
- +17Firecrawl
- +17Resend
Current top 10 companies
Oct 2026
- 93Qdrant
- 91Exa
- 89ElevenLabs
- 88Extend.ai
- 87LlamaParse
- 86LaunchDarkly
- 86Netlify
- 85Microsoft MarkItDown
- 85Razorpay
- 85Jina AI
Previous top 10 companies
May 2026
- 86You.com
- 81Exa
- 78Render
- 78Scrapfly
- 78Extend.ai
- 76Reducto
- 74Tavily
- 73Box
- 73ElevenLabs
- 72Stripe
ClickTap any row to explore the full eval.
Get your API graded →
| Rank | Tool | Score | Grade | Task | Eval | Discovery | Cost | Calls | Errors | Time | |
|---|---|---|---|---|---|---|---|---|---|---|---|
1🥇 | Qdrant | 93 | A | 96 | 89 | $0.0890 | 6 | 0 | 54s | View report | |
2🥈 | Exa | 91 | A | 89 | 95 | $0.2404 | 5 | 0 | 1m 22s | View report | |
3🥉 | ElevenLabs | 89 | B | 93 | 80 | $0.0625 | 4 | 0 | 2m 18s | View report | |
4 | Extend.ai | 88 | B | 88 | 89 | $0.1824 | 4 | 0 | 4m 31s | View report | |
5 | LlamaParse | 87 | B | 89 | 82 | $0.1594 | 3 | 0 | 2m 2s | View report | |
6 | LaunchDarkly | 86 | B | 88 | 84 | $0.1784 | 10 | 0 | 1m 21s | View report | |
6 | Netlify | 86 | B | 93 | 69 | $0.0930 | 4 | 0 | 2m 37s | View report | |
8 | Microsoft MarkItDown | 85 | B | 92 | 70 | $0.1645 | 3 | 0 | 1m 29s | View report | |
8 | Razorpay | 85 | B | 88 | 78 | $0.0741 | 6 | 0 | 3m 1s | View report | |
8 | Jina AI | 85 | B | 84 | 89 | $0.1627 | 7 | 0 | 3m 10s | View report | |
11 | Pinecone | 84 | B | 84 | 86 | $0.1725 | 8 | 0 | 3m 18s | View report | |
12 | Stripe | 83 | B | 83 | 86 | $0.1577 | 13 | 0 | 2m 3s | View report | |
12 | Box | 83 | B | 84 | 82 | $0.1333 | 9 | 0 | 4m 11s | View report | |
14 | TokenLab | 81 | B | 87 | 70 | $0.1646 | 4 | 0 | 5m 52s | View report | |
15 | Agentmail | 80 | B | 83 | 75 | $0.1215 | 6 | 0 | 5m 0s | View report | |
15 | Cartesia | 80 | B | 84 | 72 | $0.1210 | 8 | 0 | 4m 19s | View report | |
17 | Azion | 79 | B | 84 | 67 | $0.1143 | 6 | 0 | 2m 39s | View report | |
17 | Firecrawl | 79 | B | 89 | 55 | $0.1587 | 5 | 0 | 2m 10s | View report | |
17 | Resend | 79 | B | 84 | 70 | $0.1147 | 7 | 0 | 3m 34s | View report | |
17 | You.com | 79 | B | 89 | 55 | $0.1858 | 5 | 0 | 2m 43s | View report | |
17 | fastCRW | 79 | B | 89 | 55 | $0.1112 | 2 | 0 | 2m 13s | View report | |
17 | Statsig | 79 | B | 84 | 68 | $0.1332 | 8 | 0 | 3m 18s | View report | |
23 | ConfigCat | 77 | B | 80 | 70 | $0.2387 | 12 | 0 | 2m 34s | View report | |
24 | Render | 76 | B | 89 | 45 | $0.1039 | 5 | 0 | 2m 36s | View report | |
24 | Scrapfly | 76 | B | 89 | 45 | $0.1127 | 2 | 0 | 2m 42s | View report | |
26 | Reducto | 75 | B | 84 | 55 | $0.1490 | 6 | 0 | 3m 56s | View report | |
27 | BlindPay | 74 | C | 81 | 58 | $0.2114 | 9 | 0 | 3m 27s | View report | |
27 | Cloudflare | 74 | C | 74 | 74 | $0.1198 | 9 | 1 | 3m 36s | View report | |
29 | Zilliz Cloud | 73 | C | 70 | 82 | $0.1387 | 12 | 2 | 6m 2s | View report | |
30 | Descope | 71 | C | 83 | 45 | $0.1294 | 11 | 0 | 2m 32s | View report | |
31 | Flagsmith | 68 | C | 76 | 50 | $0.2104 | 24 | 0 | 3m 44s | View report | |
32 | Daytona | 67 | C | 58 | 88 | $0.0731 | 5 | 0 | 2m 10s | View report | |
33 | Twilio | 66 | C | 75 | 45 | $0.1849 | 10 | 4 | 2m 31s | View report | |
34 | Naive | 63 | C | 66 | 58 | $0.2429 | 14 | 2 | 10m 28s | View report | |
35 | MeetGeek | 57 | C | 58 | 55 | $0.0600 | 4 | 0 | 2m 16s | View report | |
35 | E2B | 57 | C | 44 | 90 | $0.1002 | 5 | 2 | 1m 49s | View report | |
37 | LiveKit | 55 | C | 49 | 70 | $0.0920 | 6 | 0 | 3m 6s | View report | |
38 | Nimble | 51 | D | 54 | 45 | $0.1891 | 5 | 0 | 3m 8s | View report | |
39 | Nylas | 49 | D | 46 | 55 | $0.1268 | 6 | 0 | 4m 9s | View report | |
40 | Adobe Acrobat | 48 | D | 44 | 58 | $0.4110 | 11 | 0 | 1m 56s | View report | |
40 | Prefect | 48 | D | 31 | 89 | $0.2242 | 22 | 7 | 3m 8s | View report | |
42 | Massive | 47 | D | 32 | 82 | $0.1255 | 15 | 5 | 4m 18s | View report | |
43 | Tavily | 45 | D | 42 | 55 | $0.1442 | 8 | 2 | 2m 0s | View report | |
44 | Clerk | 44 | D | 40 | 55 | $0.1515 | 15 | 6 | 2m 33s | View report | |
44 | Scalekit | 44 | D | 43 | 48 | $0.0669 | 5 | 3 | 4m 11s | View report | |
44 | TABStack | 44 | D | 34 | 70 | $0.1293 | 10 | 5 | 3m 15s | View report | |
47 | Chroma | 43 | D | 24 | 89 | $0.4097 | 36 | 7 | 6m 56s | View report | |
48 | Paddle | 41 | D | 35 | 55 | $0.1578 | 9 | 3 | 4m 45s | View report | |
49 | Groq | 40 | D | 24 | 77 | $0.3129 | 29 | 5 | 5m 33s | View report | |
50 | Apollo | 39 | D | 36 | 48 | $0.6450 | 17 | 0 | 9m 6s | View report | |
52 | Deepgram | 38 | D | 31 | 55 | $0.1215 | 15 | 5 | 4m 1s | View report | |
52 | Telnyx | 38 | D | 35 | 45 | $0.1974 | 13 | 4 | 3m 3s | View report | |
54 | Convex | 37 | D | 27 | 63 | $0.2186 | 25 | 3 | 5m 26s | View report | |
54 | Resemble AI | 37 | D | 40 | 30 | $0.1087 | 8 | 2 | 1m 44s | View report | |
54 | Datadog | 37 | D | 30 | 55 | $0.1245 | 16 | 4 | 5m 0s | View report | |
57 | Meeting BaaS | 35 | D | 27 | 55 | $0.3065 | 39 | 10 | 4m 29s | View report | |
58 | Plivo | 33 | D | 28 | 45 | $0.2052 | 21 | 5 | 3m 25s | View report | |
68 | LanceDB | 9 | D | 0 | 30 | $0.1841 | 20 | 0 | 1m 36s | View report | |
50 | Cerebras Payment required | — | — | — | — | — | — | — | — | — | Trace unavailable |
59 | PayPal Unable to run MCP evaluation | — | — | — | — | — | — | — | — | — | Trace unavailable |
60 | Weaviate Missing MCP auth env vars: WEAVIATE_URL, WEAVIATE_API_KEY | — | — | — | — | — | — | — | — | — | Trace unavailable |
60 | Square Missing MCP auth env vars: SQUARE_APPLICATION_ID, SQUARE_ACCESS_TOKEN | — | — | — | — | — | — | — | — | — | Trace unavailable |
62 | Merge Agent Handler Unable to run MCP evaluation | — | — | — | — | — | — | — | — | — | Trace unavailable |
62 | Composio Unable to run MCP evaluation | — | — | — | — | — | — | — | — | — | Trace unavailable |
62 | Arcade Unable to run MCP evaluation | — | — | — | — | — | — | — | — | — | Trace unavailable |
65 | Auth0 Unable to run MCP evaluation | — | — | — | — | — | — | — | — | — | Trace unavailable |
65 | Fireblocks Unable to run MCP evaluation | — | — | — | — | — | — | — | — | — | Trace unavailable |
65 | Coinbase Payments Unable to run MCP evaluation | — | — | — | — | — | — | — | — | — | Trace unavailable |
68 | Recall.ai Unable to run MCP evaluation | — | — | — | — | — | — | — | — | — | Trace unavailable |
70 | Pipecat Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | DigitalOcean Signup requires a credit card | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Perplexity API key requires a paid plan | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Adyen API key requires official certification | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Anchor Browser No MCP server package available | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Sinch Missing MCP auth env vars: SINCH_APPLICATION_KEY, SINCH_APPLICATION_SECRET | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Vonage Missing MCP auth env vars: VONAGE_APPLICATION_ID, VONAGE_PRIVATE_KEY | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Airwallex API key requires official certification | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Brave Search API key requires a paid plan | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Netflix Conductor Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Bandwidth No MCP server package available | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | OpenCageData No MCP server package available | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Cloudflare Workers MCP server requires browser-based OAuth (cannot automate) | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Stytch MCP server requires browser-based OAuth (cannot automate) | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Vercel MCP server requires browser-based OAuth (cannot automate) | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | TogetherAI API key requires a paid plan | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Railway MCP server requires browser-based OAuth (cannot automate) | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Infobip No MCP server package available | — | — | — | — | — | — | — | — | — | Trace unavailable |
| — | Fireworks AI No MCP server package available | — | — | — | — | — | — | — | — | — | Trace unavailable |
Scores calculated from end-to-end MCP evaluations by AI coding agents.
Frequently asked questions
Join the mailing list
Get updates on leaderboard changes, new benchmark releases, and product announcements.