LightsageClickTap any row to explore the full eval.
Get your API graded →
| Rank | Tool | Score | Grade | Cost | Calls | Errors | Time | Report |
|---|---|---|---|---|---|---|---|---|
🥇 | Deepgram | 94 | A | $0.0662 | 16 | 0 | 55s | |
🥈 | AssemblyAI | 90 | A | $0.0836 | 18 | 0 | 1m 12s | |
🥈 | Prefect | 90 | A | $0.0874 | 19 | 0 | 1m 20s | |
🥈 | OpenCageData | 90 | A | $0.0921 | 15 | 0 | 58s | |
🥈 | ElevenLabs | 90 | A | $0.0693 | 17 | 0 | 1m 7s | |
🥈 | Daytona | 90 | A | $0.0814 | 16 | 0 | 1m 18s | |
🥈 | Mem0 | 90 | A | $0.0885 | 20 | 0 | 1m 31s | |
8, Tied with 2 others | WorkOS | 89 | B | $0.0960 | 22 | 0 | 1m 8s | |
8, Tied with 2 others | Agentmail | 89 | B | $0.0993 | 22 | 0 | 1m 20s | |
8, Tied with 2 others | OpenRouter | 89 | B | $0.0807 | 21 | 0 | 1m 8s | |
11, Tied with 3 others | Rime | 87 | B | $0.1065 | 18 | 0 | 53s | |
11, Tied with 3 others | Tavily | 87 | B | $0.1000 | 18 | 0 | 1m 16s | |
11, Tied with 3 others | Reducto | 87 | B | $0.1320 | 19 | 0 | 1m 20s | |
11, Tied with 3 others | fastCRW | 87 | B | $0.1095 | 19 | 0 | 1m 2s | |
15, Tied with 13 others | Pipecat | 86 | B | $0.1566 | 30 | 0 | 1m 51s | |
15, Tied with 13 others | Clerk | 86 | B | $0.0854 | 21 | 1 | 1m 18s | |
15, Tied with 13 others | Stripe | 86 | B | $0.0998 | 24 | 1 | 1m 25s | |
15, Tied with 13 others | Netflix Conductor | 86 | B | $0.1079 | 27 | 0 | 1m 38s | |
15, Tied with 13 others | You.com | 86 | B | $0.1600 | 24 | 0 | 1m 55s | |
15, Tied with 13 others | Superserve | 86 | B | $0.1077 | 23 | 0 | 1m 14s | |
15, Tied with 13 others | OpenAI Whisper | 86 | B | $0.0788 | 20 | 1 | 1m 8s | |
15, Tied with 13 others | E2B | 86 | B | $0.1185 | 24 | 0 | 1m 24s | |
15, Tied with 13 others | Box | 86 | B | $0.1091 | 24 | 0 | 1m 16s | |
15, Tied with 13 others | Speechify | 86 | B | $0.0867 | 18 | 0 | 1m 10s | |
15, Tied with 13 others | Mux | 86 | B | $0.1016 | 21 | 0 | 1m 18s | |
15, Tied with 13 others | Merge Gateway | 86 | B | $0.1438 | 23 | 0 | 1m 58s | |
15, Tied with 13 others | Vercel | 86 | B | $0.0849 | 17 | 1 | 1m 24s | |
15, Tied with 13 others | Stability AI | 86 | B | $0.1225 | 21 | 0 | 1m 20s | |
29, Tied with 8 others | Scrapfly | 83 | B | $0.1028 | 15 | 0 | 55s | |
29, Tied with 8 others | Cartesia | 83 | B | $0.1833 | 19 | 0 | 1m 19s | |
29, Tied with 8 others | Resend | 83 | B | $0.1793 | 34 | 0 | 2m 9s | |
29, Tied with 8 others | Fireworks AI | 83 | B | $0.1055 | 18 | 1 | 1m 6s | |
29, Tied with 8 others | Merge | 83 | B | $0.1869 | 37 | 0 | 2m 59s | |
29, Tied with 8 others | Dropbox | 83 | B | $0.1012 | 25 | 1 | 1m 31s | |
29, Tied with 8 others | Twilio | 83 | B | $0.1530 | 24 | 5 | 1m 57s | |
29, Tied with 8 others | Exa | 83 | B | $0.1198 | 18 | 0 | 1m 35s | |
29, Tied with 8 others | CockroachDB | 83 | B | $0.1162 | 17 | 0 | 1m 16s | |
38, Tied with 5 others | Mesh API | 82 | B | $0.1135 | 21 | 0 | 1m 22s | |
38, Tied with 5 others | Blaxel | 82 | B | $0.1365 | 23 | 0 | 1m 21s | |
38, Tied with 5 others | LlamaParse | 82 | B | $0.1401 | 26 | 1 | 1m 46s | |
38, Tied with 5 others | Naive | 82 | B | $0.1146 | 21 | 0 | 1m 9s | |
38, Tied with 5 others | Orkes | 82 | B | $0.1395 | 24 | 0 | 1m 29s | |
38, Tied with 5 others | Letta | 82 | B | $0.1106 | 22 | 0 | 1m 51s | |
44, Tied with 6 others | Speechmatics | 81 | B | $0.0817 | 19 | 0 | 1m 16s | |
44, Tied with 6 others | Nebius AI Cloud | 81 | B | $0.1288 | 33 | 0 | 1m 32s | |
44, Tied with 6 others | Apify | 81 | B | $0.2045 | 22 | 1 | 1m 17s | |
44, Tied with 6 others | Bolna | 81 | B | $0.3016 | 20 | 0 | 1m 14s | |
44, Tied with 6 others | Vapi | 81 | B | $0.1932 | 35 | 0 | 4m 59s | |
44, Tied with 6 others | Nylas | 81 | B | $0.1357 | 28 | 0 | 1m 38s | |
44, Tied with 6 others | Oodle | 81 | B | $0.2081 | 38 | 0 | 2m 15s | |
51, Tied with 3 others | Postman | 80 | B | $0.1572 | 21 | 1 | 2m 0s | |
51, Tied with 3 others | Tavus | 80 | B | $0.1618 | 29 | 0 | 6m 29s | |
51, Tied with 3 others | Descope | 80 | B | $0.2531 | 28 | 1 | 1m 29s | |
51, Tied with 3 others | Modal | 80 | B | $0.0840 | 24 | 0 | 1m 21s | |
55, Tied with 10 others | LiveKit | 79 | B | $0.1331 | 25 | 2 | 1m 34s | |
55, Tied with 10 others | Qdrant | 79 | B | $0.1255 | 26 | 1 | 2m 31s | |
55, Tied with 10 others | Weaviate | 79 | B | $0.1620 | 33 | 1 | 2m 17s | |
55, Tied with 10 others | Scalekit | 79 | B | $0.1825 | 27 | 2 | 2m 8s | |
55, Tied with 10 others | Vonage | 79 | B | $0.1225 | 25 | 1 | 1m 17s | |
55, Tied with 10 others | Extend.ai | 79 | B | $0.1481 | 23 | 0 | 2m 4s | |
55, Tied with 10 others | FalkorDB | 79 | B | $0.2262 | 27 | 0 | 1m 46s | |
55, Tied with 10 others | Zoom AI Services | 79 | B | $0.1416 | 31 | 0 | 2m 19s | |
55, Tied with 10 others | Camunda | 79 | B | $0.1613 | 32 | 1 | 2m 0s | |
55, Tied with 10 others | Steel | 79 | B | $0.1547 | 29 | 1 | 2m 11s | |
55, Tied with 10 others | Neo4j | 79 | B | $0.1279 | 21 | 1 | 1m 38s | |
66, Tied with 5 others | Render | 78 | B | $0.1309 | 33 | 1 | 3m 54s | |
66, Tied with 5 others | Meetstream | 78 | B | $0.1598 | 26 | 3 | 1m 35s | |
66, Tied with 5 others | Pinecone | 78 | B | $0.1327 | 27 | 3 | 3m 46s | |
66, Tied with 5 others | Diffbot | 78 | B | $0.1368 | 23 | 0 | 1m 14s | |
66, Tied with 5 others | Surge | 78 | B | $0.0979 | 20 | 2 | 1m 7s | |
66, Tied with 5 others | Sprites | 78 | B | $0.1332 | 29 | 1 | 1m 49s | |
72, Tied with 2 others | Vectoree | 77 | B | $0.0896 | 19 | 0 | 1m 14s | |
72, Tied with 2 others | Firecrawl | 77 | B | $0.2011 | 30 | 1 | 2m 56s | |
72, Tied with 2 others | Chroma | 77 | B | $0.3336 | 41 | 4 | 2m 50s | |
75, Tied with 4 others | Diagrid | 76 | B | $0.1384 | 25 | 1 | 2m 28s | |
75, Tied with 4 others | Auth0 | 76 | B | $0.2145 | 29 | 1 | 1m 56s | |
75, Tied with 4 others | Railway | 76 | B | $0.2243 | 43 | 2 | 4m 5s | |
75, Tied with 4 others | Browser Use | 76 | B | $0.3926 | 38 | 3 | 3m 22s | |
75, Tied with 4 others | AIsa | 76 | B | $0.3028 | 27 | 1 | 1m 41s | |
80, Tied with 11 others | Zernio | 75 | B | $0.1920 | 27 | 3 | 2m 0s | |
80, Tied with 11 others | VideoDB | 75 | B | $0.2116 | 33 | 5 | 7m 6s | |
80, Tied with 11 others | Rev AI | 75 | B | $0.0651 | 15 | 0 | 2m 38s | |
80, Tied with 11 others | Zilliz Cloud | 75 | B | $0.1361 | 31 | 1 | 2m 30s | |
80, Tied with 11 others | TinyFish | 75 | B | $0.1821 | 27 | 1 | 2m 43s | |
80, Tied with 11 others | BlindPay | 75 | B | $0.1945 | 37 | 1 | 2m 26s | |
80, Tied with 11 others | Jina AI | 75 | B | $0.3049 | 36 | 5 | 5m 32s | |
80, Tied with 11 others | Apideck | 75 | B | $0.1394 | 27 | 1 | 2m 5s | |
80, Tied with 11 others | Convex | 75 | B | $0.1641 | 28 | 1 | 2m 12s | |
80, Tied with 11 others | Twelve Labs | 75 | B | $0.1531 | 29 | 2 | 2m 29s | |
80, Tied with 11 others | Memgraph | 75 | B | $0.1357 | 28 | 1 | 2m 4s | |
80, Tied with 11 others | Zep | 75 | B | $0.2215 | 29 | 1 | 7m 9s | |
92, Tied with 5 others | Mollie | 74 | C | $0.1860 | 35 | 1 | 3m 4s | |
92, Tied with 5 others | Docusign | 74 | C | $0.1719 | 28 | 0 | 2m 18s | |
92, Tied with 5 others | Restate | 74 | C | $0.4149 | 66 | 3 | 5m 31s | |
92, Tied with 5 others | Square | 74 | C | $0.1372 | 29 | 0 | 2m 11s | |
92, Tied with 5 others | Cognee | 74 | C | $0.4865 | 60 | 6 | 7m 58s | |
92, Tied with 5 others | Google DeepMind | 74 | C | $0.1550 | 24 | 3 | 3m 51s | |
98, Tied with 2 others | Groq | 73 | C | $0.0949 | 17 | 1 | 1m 23s | |
98, Tied with 2 others | HitPay | 73 | C | $0.3107 | 35 | 2 | 2m 43s | |
98, Tied with 2 others | Coinbase Payments | 73 | C | $0.2097 | 38 | 1 | 2m 39s | |
101, Tied with 3 others | Workato | 72 | C | $0.2249 | 34 | 0 | 2m 47s | |
101, Tied with 3 others | Nimble | 72 | C | $0.2127 | 28 | 2 | 3m 28s | |
101, Tied with 3 others | TigerGraph | 72 | C | $0.2671 | 42 | 5 | 4m 12s | |
101, Tied with 3 others | CopilotKit | 72 | C | $0.5091 | 37 | 3 | 2m 28s | |
105, Tied with 3 others | Agora | 71 | C | $0.4477 | 41 | 1 | 3m 33s | |
105, Tied with 3 others | Plivo | 71 | C | $0.1789 | 31 | 4 | 2m 6s | |
105, Tied with 3 others | TABStack | 71 | C | $0.2169 | 39 | 1 | 6m 23s | |
105, Tied with 3 others | Anchor Browser | 71 | C | $0.5090 | 35 | 4 | 3m 3s | |
109, Tied with 1 other | LanceDB | 70 | C | $0.1451 | 25 | 2 | 3m 1s | |
109, Tied with 1 other | Prelude | 70 | C | $0.1094 | 19 | 0 | 1m 16s | |
111 | DFNS | 69 | C | $0.1603 | 29 | 1 | 1m 55s | |
112, Tied with 1 other | BoldSign | 68 | C | $0.2956 | 34 | 1 | 2m 1s | |
112, Tied with 1 other | Freestyle | 68 | C | $0.2331 | 34 | 4 | 2m 53s | |
114, Tied with 1 other | Stytch | 67 | C | $0.2450 | 36 | 1 | 1m 44s | |
114, Tied with 1 other | Cadence | 67 | C | $0.2266 | 37 | 1 | 1m 47s | |
116 | Meeting BaaS | 66 | C | $0.1783 | 36 | 1 | 2m 2s | |
117, Tied with 3 others | Celigo | 64 | C | $1.0530 | 65 | 3 | 8m 20s | |
117, Tied with 3 others | LemonSqueezy | 64 | C | $0.1292 | 28 | 0 | 1m 48s | |
117, Tied with 3 others | Sensible | 64 | C | $0.1987 | 47 | 0 | 3m 23s | |
117, Tied with 3 others | BetterStack | 64 | C | $0.2524 | 39 | 1 | 2m 34s | |
121 | Recall.ai | 62 | C | $0.1603 | 30 | 2 | 2m 0s | |
122 | Shopware | 59 | C | $0.0961 | 19 | 0 | 47s | |
123 | Paddle | 58 | C | $0.1855 | 37 | 2 | 1m 58s | |
124 | Netlify | 53 | D | $0.1563 | 37 | 1 | 3m 4s | |
125, Tied with 1 other | PayPal | 49 | D | $0.0865 | 26 | 0 | 1m 21s | |
125, Tied with 1 other | Cloudflare | 49 | D | $0.4709 | 52 | 2 | 7m 56s | |
127 | Hookdeck | 47 | D | $0.0681 | 17 | 1 | 1m 0s | |
128 | Airwallex | 45 | D | $0.2044 | 24 | 0 | 1m 8s | |
129 | WSO2 Asgardeo | 34 | D | $0.1185 | 24 | 0 | 1m 10s | |
| — | Cloudflare Workers Task needs a paid plan (Cloudflare Sandbox SDK requires Workers Paid) | — | — | — | — | — | — | |
| — | Fireblocks Phone number needed to sign up (developer sandbox form) | — | — | — | — | — | — | |
| — | Telnyx Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Ash Hosted Ash Cloud gives no working runtime on a free account (0 credits; credits from $10) | — | — | — | — | — | — | |
| — | Sonilo API key requires a paid plan | — | — | — | — | — | — | |
| — | Unstructured Unable to obtain API key | — | — | — | — | — | — | |
| — | Datadog Unable to obtain API key | — | — | — | — | — | — | |
| — | Dust API key requires a paid plan | — | — | — | — | — | — | |
| — | ElevenLabs Music Music API requires a paid plan | — | — | — | — | — | — | |
| — | Kosuke Unable to obtain API key | — | — | — | — | — | — | |
| — | Azion CLI build and deploy outlast the harness's no-output timeout | — | — | — | — | — | — | |
| — | Nebius Token Factory Credit card needed to sign up | — | — | — | — | — | — | |
| — | Circle Faucet API requires a Mainnet account with billing details | — | — | — | — | — | — | |
| — | Temporal Credit card required to start the free trial | — | — | — | — | — | — | |
| — | Razorpay Phone number or PAN needed before *****-mode keys | — | — | — | — | — | — | |
| — | DigitalOcean Credit card needed to sign up | — | — | — | — | — | — | |
| — | TogetherAI API key requires a paid plan | — | — | — | — | — | — | |
| — | HeyGen API key requires a paid plan | — | — | — | — | — | — | |
| — | Strapi Hosted Strapi Cloud requires a paid plan (no free plan or trial) | — | — | — | — | — | — | |
| — | Upsun Access requires vendor approval | — | — | — | — | — | — | |
| — | Perplexity API key requires a paid plan | — | — | — | — | — | — | |
| — | Chargebee Credit card or phone needed to sign up (site API answers 403 api_disabled 'site is not enabled'; new account needs phone verification) | — | — | — | — | — | — | |
| — | CocoIndex Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |
| — | Gumloop Credit card needed to sign up | — | — | — | — | — | — | |
| — | Relevance AI API key requires a paid plan | — | — | — | — | — | — | |
| — | Replicate API key requires a paid plan | — | — | — | — | — | — | |
| — | Bargo Access requires vendor approval | — | — | — | — | — | — | |
| — | Massive Proxy access requires KYC verification | — | — | — | — | — | — | |
| — | Bandwidth Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | DeepInfra API key requires a paid plan | — | — | — | — | — | — | |
| — | Daily Task forbids raw REST, and Daily's Python SDK has no room or token methods | — | — | — | — | — | — | |
| — | Sinch Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | SambaNova API key requires a paid plan | — | — | — | — | — | — | |
| — | Adyen Phone number needed to sign up for a ***** account | — | — | — | — | — | — | |
| — | PandaDoc API trial used up; new accounts are suspended at signup | — | — | — | — | — | — | |
| — | Resemble AI API key requires a paid plan | — | — | — | — | — | — | |
| — | Kite No API key offered (passkey Passport and CLI only) | — | — | — | — | — | — | |
| — | Ravion Task needs a connected AWS account (card and phone required); only aws-main in AWAITING_CONNECTION, pipeline fails Ravion:AwsAccount:NOT_CONNECTED | — | — | — | — | — | — | |
| — | Mubert API key requires a paid plan | — | — | — | — | — | — | |
| — | Visa Payment-link API requires Visa approval | — | — | — | — | — | — | |
| — | Cerebras Credit card required to activate API access | — | — | — | — | — | — | |
| — |  AWS Step Functions Free sandbox account expired; a new one can be requested once a week | — | — | — | — | — | — | |
| — | Infobip Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Akka Task needs a Python SDK; Akka's SDK is Java only | — | — | — | — | — | — | |
| — | Macroscope Credit card needed to sign up | — | — | — | — | — | — | |
| — | Entrig Task needs a paid plan (Entrig sends SMS only on its $100/month plan) | — | — | — | — | — | — | |
| — | Allo Task needs a Python SDK and outbound calls, which Allo doesn't offer | — | — | — | — | — | — | |
| — | GovSpend Access requires vendor approval | — | — | — | — | — | — | |
| — | MeetGeek Task needs a paid plan (bot join requires a paid subscription) | — | — | — | — | — | — | |
| — | Brave Search Credit card needed to sign up | — | — | — | — | — | — | |
| — | 100ms Credit card required to access API keys | — | — | — | — | — | — | |
| — | Pioneer AI Credits required to create an API key (paid) | — | — | — | — | — | — | |
| — | Roster No API key configured for this company | — | — | — | — | — | — | |
| — | Pursuit API requires a paid subscription arranged through a sales meeting | — | — | — | — | — | — | |
| — | Google Lyria API key requires a paid plan | — | — | — | — | — | — | |
| — | Apollo Required API access is excluded from free and trial plans | — | — | — | — | — | — | |
| — | Loudly API key requires a paid plan | — | — | — | — | — | — | |
| — | NationGraph Unable to obtain API key | — | — | — | — | — | — | |
| — | Unclone Access requires vendor approval | — | — | — | — | — | — | |
| — | Triple-A Sandbox access requires a reviewed business inquiry | — | — | — | — | — | — | |
| — | LMNT No longer in service | — | — | — | — | — | — | |
| — |  CueMeet Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |
| — | RampRadar API keys are not self-serve (request through the Contact page) | — | — | — | — | — | — |
Scores calculated from evaluations by AI coding agents across multiple benchmarks.
Frequently asked questions
Join the mailing list
Get updates on leaderboard changes, new benchmark releases, and product announcements.