Latest results
Oct 2026 vs May 2026
Biggest improvements
Points gained since the May 2026 run
- +43Stability AI
- +29Nylas
- +29CopilotKit
- +27Mux
- +26TABStack
- +26Apollo
- +25Ravion
- +24Vercel
- +24Coinbase Payments
- +24Freestyle
Current top 10 companies
Oct 2026
- 93Stripe
- 90Apify
- 90OpenRouter
- 90Supabase
- 88Neo4j
- 86Deepgram
- 86Agentmail
- 86Scrapfly
- 86AssemblyAI
- 86Prefect
Previous top 10 companies
May 2026
- 89Box
- 86Scrapfly
- 86Datadog
- 86ElevenLabs
- 84Fireworks AI
- 84Reducto
- 83Deepgram
- 83OpenCageData
- 83Chroma
- 83Daytona
Show companies whose evals were skipped (e.g. no API key provided)
Last updated Nov 3Last updated November 3, 2026 at 9:24 PM UTC
Powered by
Lightsage
LightsageClickTap any row to explore the full eval.
Get your API graded →
Search a tool (e.g. Stripe, Chroma)
| Rank | Tool | Score | Grade | Score change | Rank change | Cost | Calls | Errors | Time | Report |
|---|---|---|---|---|---|---|---|---|---|---|
🥇 | Stripe | 93 | A | +11 since the previous batch | Up 11 places since the previous batch | $0.0762 | 6 | 2 | 36s | |
🥈 | Apify | 90 | A | New | $0.1237 | 7 | 0 | 1m 3s | ||
🥈 | OpenRouter | 90 | A | +11 since the previous batch | Up 20 places since the previous batch | $0.1176 | 6 | 0 | 58s | |
🥈 | Supabase | 90 | A | New | $0.1593 | 9 | 0 | 1m 5s | ||
5 | Neo4j | 88 | B | +9 since the previous batch | Up 17 places since the previous batch | $0.0996 | 7 | 0 | 1m 2s | |
6, Tied with 10 others | Deepgram | 86 | B | +3 since the previous batch | Up 1 place since the previous batch | $0.1728 | 8 | 1 | 1m 0s | |
6, Tied with 10 others | Agentmail | 86 | B | +14 since the previous batch | Up 58 places since the previous batch | $0.1296 | 6 | 1 | 43s | |
6, Tied with 10 others | Scrapfly | 86 | B | Down 4 places since the previous batch | $0.1597 | 10 | 2 | 1m 10s | ||
6, Tied with 10 others | AssemblyAI | 86 | B | +8 since the previous batch | Up 19 places since the previous batch | $0.1788 | 9 | 1 | 1m 20s | |
6, Tied with 10 others | Prefect | 86 | B | +10 since the previous batch | Up 25 places since the previous batch | $0.1687 | 10 | 2 | 1m 20s | |
6, Tied with 10 others | Superserve | 86 | B | +11 since the previous batch | Up 29 places since the previous batch | $0.1257 | 9 | 2 | 1m 29s | |
6, Tied with 10 others | Elasticsearch | 86 | B | New | $0.1049 | 7 | 0 | 1m 2s | ||
6, Tied with 10 others | CockroachDB | 86 | B | New | $0.1493 | 7 | 0 | 1m 5s | ||
6, Tied with 10 others | ElevenLabs | 86 | B | Down 4 places since the previous batch | $0.1244 | 10 | 1 | 1m 22s | ||
6, Tied with 10 others | Daytona | 86 | B | +3 since the previous batch | Up 1 place since the previous batch | $0.1931 | 8 | 1 | 1m 15s | |
6, Tied with 10 others | Browserbase | 86 | B | +10 since the previous batch | Up 25 places since the previous batch | $0.1789 | 10 | 1 | 1m 14s | |
17 | Mollie | 85 | B | +5 since the previous batch | Up 1 place since the previous batch | $0.1479 | 7 | 0 | 59s | |
18, Tied with 5 others | WorkOS | 84 | B | +8 since the previous batch | Up 13 places since the previous batch | $0.1885 | 14 | 4 | 1m 17s | |
18, Tied with 5 others | Chroma | 84 | B | +1 since the previous batch | Down 11 places since the previous batch | $0.1752 | 13 | 4 | 1m 48s | |
18, Tied with 5 others | Reducto | 84 | B | Down 13 places since the previous batch | $0.1793 | 13 | 1 | 1m 33s | ||
18, Tied with 5 others | E2B | 84 | B | +7 since the previous batch | Up 10 places since the previous batch | $0.1222 | 13 | 5 | 1m 15s | |
18, Tied with 5 others | Box | 84 | B | −5 since the previous batch | Down 17 places since the previous batch | $0.1809 | 15 | 1 | 1m 38s | |
18, Tied with 5 others | Vercel | 84 | B | +24 since the previous batch | Up 92 places since the previous batch | $0.2375 | 10 | 1 | 1m 12s | |
24, Tied with 1 other | Clerk | 83 | B | +7 since the previous batch | Up 7 places since the previous batch | $0.2521 | 11 | 2 | 1m 14s | |
24, Tied with 1 other | Fireworks AI | 83 | B | −1 since the previous batch | Down 19 places since the previous batch | $0.2194 | 11 | 1 | 1m 12s | |
26, Tied with 2 others | AINative Studio | 82 | B | New | $0.2565 | 12 | 0 | 1m 37s | ||
26, Tied with 2 others | Olostep | 82 | B | New | $0.3103 | 15 | 0 | 1m 54s | ||
26, Tied with 2 others | You.com | 82 | B | +9 since the previous batch | Up 25 places since the previous batch | $0.2877 | 19 | 0 | 2m 10s | |
29, Tied with 1 other | Firecrawl | 81 | B | +6 since the previous batch | Up 6 places since the previous batch | $0.4370 | 18 | 0 | 2m 51s | |
29, Tied with 1 other | Datadog | 81 | B | −5 since the previous batch | Down 27 places since the previous batch | $0.3024 | 18 | 3 | 1m 49s | |
31, Tied with 1 other | ZenRows | 80 | B | New | $0.1678 | 11 | 2 | 1m 13s | ||
31, Tied with 1 other | Steel | 80 | B | +9 since the previous batch | Up 35 places since the previous batch | $0.2532 | 13 | 2 | 2m 30s | |
33, Tied with 5 others | Render | 79 | B | +4 since the previous batch | Up 2 places since the previous batch | $0.2750 | 13 | 1 | 3m 1s | |
33, Tied with 5 others | Qdrant | 79 | B | +2 since the previous batch | Down 5 places since the previous batch | $0.2976 | 19 | 1 | 2m 42s | |
33, Tied with 5 others | Meetstream | 79 | B | +6 since the previous batch | Up 18 places since the previous batch | $0.3131 | 12 | 1 | 1m 25s | |
33, Tied with 5 others | OpenCageData | 79 | B | −4 since the previous batch | Down 26 places since the previous batch | $0.2644 | 15 | 3 | 1m 42s | |
33, Tied with 5 others | Blaxel | 79 | B | +10 since the previous batch | Up 42 places since the previous batch | $0.3074 | 11 | 1 | 1m 51s | |
33, Tied with 5 others | Sonilo | 79 | B | −2 since the previous batch | Down 20 places since the previous batch | $0.3367 | 18 | 4 | 2m 21s | |
39, Tied with 3 others | Mesh API | 78 | B | +9 since the previous batch | Up 36 places since the previous batch | $0.2280 | 12 | 0 | 1m 57s | |
39, Tied with 3 others | Exa | 78 | B | +8 since the previous batch | Up 31 places since the previous batch | $0.3265 | 17 | 0 | 2m 1s | |
39, Tied with 3 others | Modal | 78 | B | Down 14 places since the previous batch | $0.1234 | 6 | 1 | 1m 4s | ||
39, Tied with 3 others | Tenki | 78 | B | +20 since the previous batch | Up 78 places since the previous batch | $0.1762 | 8 | 1 | 1m 29s | |
43, Tied with 6 others | Diagrid | 77 | B | New | $0.2896 | 18 | 4 | 1m 55s | ||
43, Tied with 6 others | Cartesia | 77 | B | +11 since the previous batch | Up 48 places since the previous batch | $0.2855 | 19 | 4 | 1m 52s | |
43, Tied with 6 others | Auth0 | 77 | B | +8 since the previous batch | Up 32 places since the previous batch | $0.5098 | 27 | 4 | 2m 57s | |
43, Tied with 6 others | Groq | 77 | B | +2 since the previous batch | Down 8 places since the previous batch | $0.1672 | 7 | 0 | 1m 0s | |
43, Tied with 6 others | Pinecone | 77 | B | +6 since the previous batch | Up 23 places since the previous batch | $0.3531 | 19 | 4 | 3m 32s | |
43, Tied with 6 others | Tavily | 77 | B | +3 since the previous batch | $0.3549 | 19 | 2 | 3m 24s | ||
43, Tied with 6 others | Unstructured | 77 | B | +3 since the previous batch | $0.3675 | 26 | 5 | 2m 47s | ||
50, Tied with 3 others | Resend | 76 | B | +1 since the previous batch | Down 15 places since the previous batch | $0.5267 | 22 | 5 | 3m 37s | |
50, Tied with 3 others | Browser Use | 76 | B | +3 since the previous batch | Up 1 place since the previous batch | $0.4220 | 24 | 2 | 3m 53s | |
50, Tied with 3 others | Merge Gateway | 76 | B | +14 since the previous batch | Up 53 places since the previous batch | $0.3961 | 27 | 4 | 3m 4s | |
50, Tied with 3 others | Zep | 76 | B | +7 since the previous batch | Up 25 places since the previous batch | $0.5222 | 20 | 2 | 4m 15s | |
54, Tied with 6 others | TinyFish | 75 | B | +2 since the previous batch | Down 3 places since the previous batch | $0.3224 | 18 | 2 | 2m 46s | |
54, Tied with 6 others | Jina AI | 75 | B | −3 since the previous batch | Down 29 places since the previous batch | $0.4145 | 21 | 0 | 4m 35s | |
54, Tied with 6 others | Docusign | 75 | B | +4 since the previous batch | Up 12 places since the previous batch | $0.1954 | 11 | 2 | 1m 50s | |
54, Tied with 6 others | Telnyx | 75 | B | +1 since the previous batch | Down 11 places since the previous batch | $0.4310 | 29 | 10 | 4m 2s | |
54, Tied with 6 others | Speechify | 75 | B | −5 since the previous batch | Down 36 places since the previous batch | $0.1476 | 11 | 0 | 1m 36s | |
54, Tied with 6 others | Orkes | 75 | B | New | $0.3478 | 9 | 0 | 1m 32s | ||
54, Tied with 6 others | fastCRW | 75 | B | −2 since the previous batch | Down 26 places since the previous batch | $0.5136 | 27 | 4 | 4m 13s | |
61, Tied with 11 others | Zernio | 74 | C | New | $0.4741 | 17 | 6 | 2m 42s | ||
61, Tied with 11 others | Postman | 74 | C | +5 since the previous batch | Up 14 places since the previous batch | $0.3951 | 19 | 1 | 2m 32s | |
61, Tied with 11 others | Fly.io | 74 | C | New | $0.6024 | 29 | 2 | 8m 31s | ||
61, Tied with 11 others | Tavus | 74 | C | +14 since the previous batch | Up 49 places since the previous batch | $0.2530 | 14 | 1 | 4m 18s | |
61, Tied with 11 others | Descope | 74 | C | +1 since the previous batch | Down 10 places since the previous batch | $0.3145 | 16 | 3 | 2m 1s | |
61, Tied with 11 others | Merge | 74 | C | Down 18 places since the previous batch | $0.4269 | 25 | 1 | 6m 14s | ||
61, Tied with 11 others | Scalekit | 74 | C | +1 since the previous batch | Down 10 places since the previous batch | $0.9843 | 38 | 8 | 4m 10s | |
61, Tied with 11 others | Dropbox | 74 | C | +4 since the previous batch | Up 9 places since the previous batch | $0.2467 | 11 | 4 | 1m 47s | |
61, Tied with 11 others | Twilio | 74 | C | +1 since the previous batch | Down 10 places since the previous batch | $0.7006 | 25 | 5 | 5m 24s | |
61, Tied with 11 others | Diffbot | 74 | C | +8 since the previous batch | Up 30 places since the previous batch | $0.2100 | 11 | 2 | 1m 59s | |
61, Tied with 11 others | Extend.ai | 74 | C | +1 since the previous batch | Down 10 places since the previous batch | $0.3794 | 17 | 1 | 2m 18s | |
61, Tied with 11 others | Anchor Browser | 74 | C | −9 since the previous batch | Down 54 places since the previous batch | $0.3496 | 25 | 5 | 2m 47s | |
73, Tied with 2 others | Keenable | 73 | C | New | $0.3434 | 16 | 1 | 3m 9s | ||
73, Tied with 2 others | AgentLine | 73 | C | New | $0.3474 | 20 | 0 | 2m 57s | ||
73, Tied with 2 others | Memgraph | 73 | C | +3 since the previous batch | Down 3 places since the previous batch | $0.1662 | 9 | 1 | 1m 8s | |
76, Tied with 7 others | LanceDB | 72 | C | −3 since the previous batch | Down 41 places since the previous batch | $0.4443 | 16 | 2 | 4m 32s | |
76, Tied with 7 others | Circle | 72 | C | +3 since the previous batch | Down 1 place since the previous batch | $1.5889 | 73 | 20 | 11m 39s | |
76, Tied with 7 others | Razorpay | 72 | C | −1 since the previous batch | Down 25 places since the previous batch | $0.3202 | 22 | 6 | 3m 3s | |
76, Tied with 7 others | Restate | 72 | C | −1 since the previous batch | Down 25 places since the previous batch | $1.1678 | 51 | 11 | 7m 31s | |
76, Tied with 7 others | Vapi | 72 | C | Down 12 places since the previous batch | $1.0258 | 49 | 3 | 14m 13s | ||
76, Tied with 7 others | Nimble | 72 | C | +3 since the previous batch | Down 1 place since the previous batch | $1.1171 | 56 | 13 | 24m 25s | |
76, Tied with 7 others | Resemble AI | 72 | C | −7 since the previous batch | Down 54 places since the previous batch | $0.1767 | 17 | 1 | 2m 49s | |
76, Tied with 7 others | Mem0 | 72 | C | +3 since the previous batch | Down 1 place since the previous batch | $0.8911 | 45 | 9 | 14m 3s | |
84, Tied with 6 others | PayPal | 71 | C | +2 since the previous batch | Down 9 places since the previous batch | $0.4821 | 26 | 3 | 4m 2s | |
84, Tied with 6 others | Rime | 71 | C | −9 since the previous batch | Down 66 places since the previous batch | $0.1634 | 12 | 2 | 1m 9s | |
84, Tied with 6 others | HeyGen | 71 | C | +11 since the previous batch | Up 26 places since the previous batch | $0.6298 | 38 | 7 | 4m 34s | |
84, Tied with 6 others | Apideck | 71 | C | −4 since the previous batch | Down 49 places since the previous batch | $0.5110 | 29 | 5 | 4m 2s | |
84, Tied with 6 others | LlamaParse | 71 | C | −3 since the previous batch | Down 41 places since the previous batch | $0.5307 | 29 | 8 | 3m 48s | |
84, Tied with 6 others | Mux | 71 | C | +27 since the previous batch | Up 44 places since the previous batch | $0.4651 | 27 | 4 | 3m 44s | |
84, Tied with 6 others | Google DeepMind | 71 | C | +10 since the previous batch | Up 22 places since the previous batch | $0.3440 | 12 | 2 | 2m 6s | |
91, Tied with 4 others | Kosuke | 70 | C | New | $0.4567 | 24 | 4 | 6m 22s | ||
91, Tied with 4 others | TABStack | 70 | C | +26 since the previous batch | Up 37 places since the previous batch | $0.7577 | 24 | 1 | 6m 20s | |
91, Tied with 4 others | Sprites (Fly.io) | 70 | C | $0.8192 | 40 | 5 | 4m 46s | |||
91, Tied with 4 others | Twelve Labs | 70 | C | +2 since the previous batch | Down 2 places since the previous batch | $0.2571 | 19 | 2 | 2m 38s | |
91, Tied with 4 others | AIsa | 70 | C | +1 since the previous batch | Down 16 places since the previous batch | $0.3265 | 18 | 2 | 2m 30s | |
96, Tied with 6 others | Rev AI | 69 | C | −4 since the previous batch | Down 45 places since the previous batch | $0.1308 | 8 | 1 | 3m 14s | |
96, Tied with 6 others | Zilliz Cloud | 69 | C | Down 21 places since the previous batch | $0.8398 | 47 | 13 | 7m 36s | ||
96, Tied with 6 others | PandaDoc | 69 | C | −5 since the previous batch | Down 53 places since the previous batch | $0.9117 | 33 | 4 | 6m 10s | |
96, Tied with 6 others | Nylas | 69 | C | +29 since the previous batch | Up 39 places since the previous batch | $0.7979 | 34 | 9 | 6m 50s | |
96, Tied with 6 others | Cloudflare | 69 | C | Down 21 places since the previous batch | $0.7800 | 39 | 6 | 7m 27s | ||
96, Tied with 6 others | Replicate | 69 | C | −5 since the previous batch | Down 53 places since the previous batch | $0.5022 | 27 | 8 | 5m 36s | |
96, Tied with 6 others | Apollo | 69 | C | +26 since the previous batch | Up 37 places since the previous batch | $0.4487 | 16 | 3 | 2m 43s | |
103, Tied with 5 others | BoldSign | 68 | C | +2 since the previous batch | Down 12 places since the previous batch | $0.3709 | 27 | 3 | 2m 51s | |
103, Tied with 5 others | Agora | 68 | C | −1 since the previous batch | Down 28 places since the previous batch | $1.0446 | 54 | 8 | 6m 16s | |
103, Tied with 5 others | Chargebee | 68 | C | −1 since the previous batch | Down 28 places since the previous batch | $1.0861 | 58 | 11 | 5m 45s | |
103, Tied with 5 others | Coinbase Payments | 68 | C | +24 since the previous batch | Up 25 places since the previous batch | $1.2164 | 61 | 14 | 9m 3s | |
103, Tied with 5 others | FalkorDB | 68 | C | +6 since the previous batch | $0.3023 | 19 | 3 | 4m 10s | ||
103, Tied with 5 others | CopilotKit | 68 | C | +29 since the previous batch | Up 34 places since the previous batch | $0.3691 | 23 | 6 | 3m 3s | |
109, Tied with 3 others | Azion | 67 | C | New | $5.1466 | 160 | 5 | 51m 51s | ||
109, Tied with 3 others | HitPay | 67 | C | +3 since the previous batch | Down 12 places since the previous batch | $0.4700 | 21 | 1 | 3m 26s | |
109, Tied with 3 others | Cognee | 67 | C | −1 since the previous batch | Down 20 places since the previous batch | $1.6022 | 66 | 11 | 15m 56s | |
109, Tied with 3 others | Stability AI | 67 | C | +43 since the previous batch | Up 31 places since the previous batch | $0.1975 | 16 | 0 | 2m 16s | |
113, Tied with 1 other | Okta | 66 | C | New | $0.7571 | 51 | 1 | 4m 57s | ||
113, Tied with 1 other | Prelude | 66 | C | +1 since the previous batch | Down 18 places since the previous batch | $0.2245 | 13 | 3 | 1m 54s | |
115, Tied with 1 other | Railway | 65 | C | +1 since the previous batch | Down 18 places since the previous batch | $0.9071 | 54 | 4 | 6m 13s | |
115, Tied with 1 other | Dust | 65 | C | −8 since the previous batch | Down 64 places since the previous batch | $0.6904 | 30 | 3 | 5m 12s | |
117, Tied with 6 others | Subotiz | 64 | C | New | $1.1519 | 58 | 4 | 6m 56s | ||
117, Tied with 6 others | LiveKit | 64 | C | −17 since the previous batch | Down 104 places since the previous batch | $0.6281 | 40 | 4 | 13m 12s | |
117, Tied with 6 others | Freestyle | 64 | C | +24 since the previous batch | Up 18 places since the previous batch | $1.1996 | 56 | 8 | 7m 51s | |
117, Tied with 6 others | Meeting BaaS | 64 | C | +1 since the previous batch | Down 16 places since the previous batch | $0.5126 | 24 | 9 | 2m 53s | |
117, Tied with 6 others | Sensible | 64 | C | +4 since the previous batch | Down 7 places since the previous batch | $0.4741 | 15 | 0 | 3m 58s | |
117, Tied with 6 others | Zoom AI Services | 64 | C | +5 since the previous batch | Down 3 places since the previous batch | $1.0372 | 42 | 10 | 5m 48s | |
117, Tied with 6 others | Letta | 64 | C | Down 20 places since the previous batch | $0.8405 | 37 | 7 | 7m 4s | ||
124, Tied with 5 others | Vectoree | 63 | C | New | $0.2940 | 13 | 1 | 2m 9s | ||
124, Tied with 5 others | Celigo | 63 | C | New | $1.4695 | 30 | 0 | 8m 15s | ||
124, Tied with 5 others | VideoDB | 63 | C | −3 since the previous batch | Down 33 places since the previous batch | $1.6324 | 66 | 8 | 11m 0s | |
124, Tied with 5 others | Daily | 63 | C | +7 since the previous batch | Down 2 places since the previous batch | $0.4830 | 24 | 5 | 4m 34s | |
124, Tied with 5 others | Plivo | 63 | C | +7 since the previous batch | Down 2 places since the previous batch | $0.4225 | 25 | 13 | 3m 23s | |
124, Tied with 5 others | Ravion | 63 | C | +25 since the previous batch | Up 14 places since the previous batch | $1.7805 | 53 | 8 | 10m 34s | |
130 | DFNS | 62 | C | −11 since the previous batch | Down 79 places since the previous batch | $0.6667 | 37 | 3 | 4m 4s | |
131, Tied with 2 others | MeetGeek | 61 | C | +5 since the previous batch | Down 9 places since the previous batch | $0.3089 | 20 | 6 | 2m 23s | |
131, Tied with 2 others | Square | 61 | C | $0.8269 | 35 | 7 | 4m 13s | |||
131, Tied with 2 others | BetterStack | 61 | C | Down 25 places since the previous batch | $0.7068 | 34 | 4 | 4m 38s | ||
134 | Surge | 60 | C | −3 since the previous batch | Down 33 places since the previous batch | $0.4215 | 23 | 4 | 2m 42s | |
135, Tied with 3 others | Infobip | 59 | C | +1 since the previous batch | Down 18 places since the previous batch | $0.4119 | 32 | 3 | 2m 40s | |
135, Tied with 3 others | Workato | 59 | C | New | $1.6071 | 64 | 5 | 11m 42s | ||
135, Tied with 3 others | Stytch | 59 | C | +3 since the previous batch | Down 13 places since the previous batch | $1.1280 | 59 | 10 | 6m 44s | |
135, Tied with 3 others | Recall.ai | 59 | C | +2 since the previous batch | Down 16 places since the previous batch | $0.3441 | 12 | 2 | 2m 6s | |
139 | LemonSqueezy | 47 | D | −10 since the previous batch | Down 20 places since the previous batch | $0.7086 | 33 | 10 | 6m 5s | |
140, Tied with 1 other | BlindPay | 44 | D | Down 12 places since the previous batch | $1.4168 | 62 | 15 | 9m 1s | ||
140, Tied with 1 other | Upsun | 44 | D | Down 12 places since the previous batch | $1.0657 | 47 | 3 | 7m 43s | ||
142 | YoloCode | 34 | D | New | $0.0000 | 17 | 1 | 40m 22s | ||
143 | NationGraph | 22 | D | −6 since the previous batch | Down 4 places since the previous batch | $1.0043 | 42 | 6 | 8m 44s | |
| — | Naive API key requires a paid plan | — | — | — | — | — | — | |||
| — | Temporal Unable to obtain an API key | — | — | — | — | — | — | |||
| — | Massive Unable to obtain an API key | — | — | — | — | — | — | |||
| — | ElevenLabs Music API key requires a paid plan | — | — | — | — | — | — | |||
| — | Cerebras API key requires a paid plan | — | — | — | — | — | — | |||
| — | Paddle Unable to obtain an API key | — | — | — | — | — | — | |||
| — | SambaNova API key requires a paid plan | — | — | — | — | — | — | |||
| — | TigerGraph Unable to obtain an API key | — | — | — | — | — | — | |||
| — | Pioneer AI API key requires a paid plan | — | — | — | — | — | — | |||
| — | GovSpend Unable to obtain an API key | — | — | — | — | — | — | |||
| — | LMNT No longer in service (LMNT has shut down) | — | — | — | — | — | — | |||
| — | Pursuit Unable to obtain an API key | — | — | — | — | — | — | |||
| — | Shopware Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |||
| — | Oodle Could not obtain API key | — | — | — | — | — | — | |||
| — | CocoIndex Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |||
| — | Gumloop API key requires a paid plan | — | — | — | — | — | — | |||
| — | Relevance AI API key requires a paid plan | — | — | — | — | — | — | |||
| — | Nebius Token Factory API key requires a paid plan | — | — | — | — | — | — | |||
| — | Nebius AI Cloud API key requires a paid plan | — | — | — | — | — | — | |||
| — | Hookdeck Could not obtain API key | — | — | — | — | — | — | |||
| — | Mubert API key requires a paid plan | — | — | — | — | — | — | |||
| — | Bargo Could not obtain API key | — | — | — | — | — | — | |||
| — | Visa API key requires official certification or company verification | — | — | — | — | — | — | |||
| — | Entrig Could not obtain API key | — | — | — | — | — | — | |||
| — | Packrift Could not obtain API key | — | — | — | — | — | — | |||
| — | Google Lyria API key requires a paid plan | — | — | — | — | — | — | |||
| — | Kite Unable to obtain an API key | — | — | — | — | — | — | |||
| — | Allo Unable to obtain an API key | — | — | — | — | — | — | |||
| — | Loudly Could not obtain API key | — | — | — | — | — | — | |||
| — | RampRadar API key requires official certification or company verification | — | — | — | — | — | — | |||
| — | Unclone API key requires a paid plan | — | — | — | — | — | — | |||
| — | Pipecat Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |||
| — | Cloudflare Workers Could not obtain API key | — | — | — | — | — | — | |||
| — | Netlify Could not obtain API key | — | — | — | — | — | — | |||
| — | Ash Could not obtain API key | — | — | — | — | — | — | |||
| — | Camunda Could not obtain API key | — | — | — | — | — | — | |||
| — | Weaviate Could not obtain API key | — | — | — | — | — | — | |||
| — | Netflix Conductor Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |||
| — | Bandwidth Could not obtain API key | — | — | — | — | — | — | |||
| — | DigitalOcean Signup requires a credit card | — | — | — | — | — | — | |||
| — | Fireblocks Could not obtain API key | — | — | — | — | — | — | |||
| — | TogetherAI API key requires a paid plan | — | — | — | — | — | — | |||
| — | Convex Could not obtain API key | — | — | — | — | — | — | |||
| — | Vonage Could not obtain API key | — | — | — | — | — | — | |||
| — | Speechmatics API key requires a paid plan | — | — | — | — | — | — | |||
| — | Akka Could not obtain API key | — | — | — | — | — | — | |||
| — | DeepInfra API key requires a paid plan | — | — | — | — | — | — | |||
| — | Perplexity API key requires a paid plan | — | — | — | — | — | — | |||
| — | Adyen API key requires official certification or company verification | — | — | — | — | — | — | |||
| — | OpenAI Whisper API key requires a paid plan | — | — | — | — | — | — | |||
| — |  AWS Step Functions Could not obtain API key | — | — | — | — | — | — | |||
| — | Brave Search API key requires a paid plan | — | — | — | — | — | — | |||
| — | Sinch Could not obtain API key | — | — | — | — | — | — | |||
| — | 100ms API key requires a paid plan | — | — | — | — | — | — | |||
| — | Macroscope Could not obtain API key | — | — | — | — | — | — | |||
| — | Strapi Could not obtain API key | — | — | — | — | — | — | |||
| — | Cadence Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |||
| — | Airwallex API key requires official certification or company verification | — | — | — | — | — | — | |||
| — | Bolna Could not obtain API key | — | — | — | — | — | — | |||
| — | Roster No API key configured for this company | — | — | — | — | — | — | |||
| — | Triple-A Could not obtain API key | — | — | — | — | — | — | |||
| — |  CueMeet Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — |
Scores calculated from evaluations by AI coding agents across multiple benchmarks.
Frequently asked questions
Join the mailing list
Get updates on leaderboard changes, new benchmark releases, and product announcements.
Browse All Providers (174)
StripeApifyOpenRouterSupabaseNeo4jDeepgramAgentmailScrapflyAssemblyAIPrefectSuperserveElasticsearchCockroachDBElevenLabsDaytonaBrowserbaseMollieWorkOSChromaReductoE2BBoxVercelClerkFireworks AIAINative StudioOlostepYou.comFirecrawlDatadogZenRowsSteelRenderQdrantMeetstreamOpenCageDataBlaxelSoniloMesh APIExaModalTenkiDiagridCartesiaAuth0GroqPineconeTavilyUnstructuredResendBrowser UseMerge GatewayZepTinyFishJina AIDocusignTelnyxSpeechifyOrkesfastCRWZernioPostmanFly.ioTavusDescopeMergeScalekitDropboxTwilioDiffbotExtend.aiAnchor BrowserKeenableAgentLineMemgraphLanceDBCircleRazorpayRestateVapiNimbleResemble AINaiveMem0PayPalRimeHeyGenApideckLlamaParseMuxGoogle DeepMindKosukeTemporalMassiveTABStackSprites (Fly.io)Twelve LabsAIsaRev AIZilliz CloudPandaDocNylasCloudflareReplicateApolloBoldSignAgoraChargebeeCoinbase PaymentsFalkorDBCopilotKitAzionHitPayCogneeStability AIOktaPreludeRailwayDustSubotizLiveKitFreestyleMeeting BaaSSensibleZoom AI ServicesLettaVectoreeCeligoVideoDBDailyPlivoRavionDFNSMeetGeekSquareBetterStackSurgeInfobipWorkatoStytchRecall.aiElevenLabs MusicLemonSqueezyCerebrasPaddleBlindPayUpsunSambaNovaTigerGraphPioneer AIGovSpendLMNTYoloCodePursuitShopwareOodleCocoIndexGumloopRelevance AINationGraphNebius Token FactoryNebius AI CloudHookdeckMubertBargoVisaEntrigPackriftGoogle LyriaKiteAlloLoudlyRampRadarUnclone