LightsageClickTap any row to explore the full eval.
Get your API graded →
| Rank | Tool | Score | Grade | Cost | Calls | Errors | Time | Report |
|---|---|---|---|---|---|---|---|---|
🥇 | AssemblyAI | 90 | A | $0.1970 | 10 | 0 | 1m 4s | |
🥈 | Fireworks AI | 88 | B | $0.2545 | 9 | 0 | 1m 13s | |
🥉 | Deepgram | 86 | B | $0.2154 | 11 | 0 | 1m 41s | |
🥉 | Prefect | 86 | B | $0.2936 | 13 | 0 | 1m 36s | |
🥉 | Reducto | 86 | B | $0.3032 | 12 | 0 | 1m 47s | |
🥉 | Vercel | 86 | B | $0.3373 | 14 | 0 | 1m 56s | |
7, Tied with 1 other | Clerk | 84 | B | $0.4672 | 20 | 0 | 1m 51s | |
7, Tied with 1 other | OpenCageData | 84 | B | $0.2187 | 10 | 0 | 1m 4s | |
9, Tied with 1 other | OpenRouter | 83 | B | $0.5311 | 21 | 0 | 1m 43s | |
9, Tied with 1 other | Box | 83 | B | $0.3922 | 15 | 0 | 2m 12s | |
11, Tied with 3 others | Weaviate | 82 | B | $0.2030 | 12 | 0 | 3m 4s | |
11, Tied with 3 others | Dropbox | 82 | B | $0.2940 | 14 | 0 | 1m 55s | |
11, Tied with 3 others | Bolna | 82 | B | $0.2382 | 11 | 0 | 58s | |
11, Tied with 3 others | ElevenLabs | 82 | B | $0.2310 | 13 | 0 | 3m 33s | |
15, Tied with 3 others | WorkOS | 81 | B | $0.5261 | 17 | 1 | 1m 23s | |
15, Tied with 3 others | fastCRW | 81 | B | $0.5408 | 23 | 0 | 2m 26s | |
15, Tied with 3 others | Daytona | 81 | B | $0.6287 | 23 | 0 | 2m 20s | |
15, Tied with 3 others | Browserbase | 81 | B | $0.4502 | 19 | 0 | 2m 34s | |
19, Tied with 3 others | Stripe | 80 | B | $0.5753 | 21 | 2 | 1m 59s | |
19, Tied with 3 others | Superserve | 80 | B | $0.4923 | 28 | 0 | 2m 54s | |
19, Tied with 3 others | E2B | 80 | B | $0.6229 | 30 | 0 | 2m 39s | |
19, Tied with 3 others | Merge Gateway | 80 | B | $0.5516 | 27 | 0 | 2m 15s | |
23, Tied with 5 others | Postman | 79 | B | $0.5397 | 17 | 0 | 7m 52s | |
23, Tied with 5 others | Tavus | 79 | B | $0.5522 | 16 | 0 | 5m 57s | |
23, Tied with 5 others | LiveKit | 79 | B | $0.3495 | 15 | 0 | 2m 3s | |
23, Tied with 5 others | Rime | 79 | B | $0.1556 | 8 | 1 | 2m 35s | |
23, Tied with 5 others | LlamaParse | 79 | B | $0.4662 | 16 | 0 | 8m 0s | |
23, Tied with 5 others | Neo4j | 79 | B | $0.3034 | 14 | 1 | 1m 57s | |
29, Tied with 3 others | Restate | 78 | B | $0.3430 | 21 | 0 | 10m 29s | |
29, Tied with 3 others | Tavily | 78 | B | $0.5238 | 17 | 0 | 12m 7s | |
29, Tied with 3 others | OpenAI Whisper | 78 | B | $0.2736 | 11 | 0 | 4m 26s | |
29, Tied with 3 others | Google DeepMind | 78 | B | $0.2463 | 13 | 0 | 1m 53s | |
33, Tied with 4 others | Pinecone | 77 | B | $0.4691 | 21 | 1 | 2m 14s | |
33, Tied with 4 others | Exa | 77 | B | $0.4538 | 17 | 0 | 2m 43s | |
33, Tied with 4 others | Chroma | 77 | B | $1.3316 | 32 | 0 | 3m 19s | |
33, Tied with 4 others | Netlify | 77 | B | $0.5267 | 22 | 0 | 11m 9s | |
33, Tied with 4 others | FalkorDB | 77 | B | $0.4684 | 19 | 0 | 2m 13s | |
38, Tied with 8 others | Pipecat | 76 | B | $2.5232 | 23 | 0 | 6m 51s | |
38, Tied with 8 others | Render | 76 | B | $1.4499 | 32 | 0 | 6m 21s | |
38, Tied with 8 others | Agentmail | 76 | B | $0.3774 | 23 | 0 | 4m 0s | |
38, Tied with 8 others | Cartesia | 76 | B | $0.4100 | 19 | 1 | 1m 45s | |
38, Tied with 8 others | Nebius AI Cloud | 76 | B | $0.2556 | 15 | 0 | 9m 14s | |
38, Tied with 8 others | Resend | 76 | B | $0.6501 | 37 | 0 | 13m 57s | |
38, Tied with 8 others | Camunda | 76 | B | $2.2112 | 54 | 0 | 9m 16s | |
38, Tied with 8 others | Steel | 76 | B | $0.7161 | 26 | 0 | 6m 5s | |
38, Tied with 8 others | Mem0 | 76 | B | $1.5200 | 34 | 0 | 5m 49s | |
47, Tied with 11 others | Shopware | 75 | B | $1.6429 | 33 | 0 | 14m 6s | |
47, Tied with 11 others | Speechmatics | 75 | B | $0.2275 | 12 | 0 | 2m 58s | |
47, Tied with 11 others | Qdrant | 75 | B | $0.7287 | 23 | 1 | 3m 13s | |
47, Tied with 11 others | Paddle | 75 | B | $1.8032 | 39 | 0 | 10m 10s | |
47, Tied with 11 others | Descope | 75 | B | $0.9417 | 26 | 0 | 2m 40s | |
47, Tied with 11 others | Merge | 75 | B | $1.1737 | 34 | 0 | 15m 20s | |
47, Tied with 11 others | Groq | 75 | B | $0.2080 | 9 | 0 | 1m 44s | |
47, Tied with 11 others | Scalekit | 75 | B | $1.6506 | 42 | 0 | 13m 26s | |
47, Tied with 11 others | Twilio | 75 | B | $0.5017 | 18 | 3 | 6m 54s | |
47, Tied with 11 others | Docusign | 75 | B | $0.1981 | 13 | 0 | 3m 52s | |
47, Tied with 11 others | Vapi | 75 | B | $7.3166 | 129 | 0 | 16m 18s | |
47, Tied with 11 others | Oodle | 75 | B | $4.3139 | 62 | 0 | 19m 2s | |
59, Tied with 6 others | Firecrawl | 74 | C | $0.6799 | 28 | 1 | 6m 41s | |
59, Tied with 6 others | TinyFish | 74 | C | $0.6117 | 26 | 0 | 3m 24s | |
59, Tied with 6 others | BlindPay | 74 | C | $1.0461 | 35 | 0 | 2m 58s | |
59, Tied with 6 others | Auth0 | 74 | C | $1.5042 | 5 | 0 | 2m 14s | |
59, Tied with 6 others | You.com | 74 | C | $0.9589 | 30 | 1 | 4m 21s | |
59, Tied with 6 others | Nimble | 74 | C | $0.6580 | 27 | 0 | 3m 13s | |
59, Tied with 6 others | Extend.ai | 74 | C | $0.8142 | 44 | 0 | 4m 43s | |
66, Tied with 9 others | Zernio | 73 | C | $1.8276 | 44 | 0 | 3m 24s | |
66, Tied with 9 others | VideoDB | 73 | C | $0.9482 | 46 | 2 | 6m 23s | |
66, Tied with 9 others | Meetstream | 73 | C | $0.5747 | 23 | 1 | 2m 58s | |
66, Tied with 9 others | Vonage | 73 | C | $0.4949 | 29 | 0 | 5m 28s | |
66, Tied with 9 others | Nylas | 73 | C | $0.5678 | 27 | 0 | 7m 54s | |
66, Tied with 9 others | Browser Use | 73 | C | $2.8660 | 54 | 2 | 7m 2s | |
66, Tied with 9 others | Blaxel | 73 | C | $1.9557 | 46 | 0 | 3m 29s | |
66, Tied with 9 others | Speechify | 73 | C | $0.4371 | 25 | 2 | 2m 23s | |
66, Tied with 9 others | Mux | 73 | C | $1.8028 | 52 | 3 | 7m 9s | |
66, Tied with 9 others | CopilotKit | 73 | C | $0.9503 | 25 | 0 | 7m 50s | |
76, Tied with 9 others | Mesh API | 72 | C | $0.8643 | 36 | 1 | 2m 25s | |
76, Tied with 9 others | Netflix Conductor | 72 | C | $1.3951 | 64 | 1 | 13m 24s | |
76, Tied with 9 others | Apideck | 72 | C | $1.7731 | 70 | 0 | 7m 6s | |
76, Tied with 9 others | Coinbase Payments | 72 | C | $0.8993 | 33 | 1 | 2m 37s | |
76, Tied with 9 others | Cognee | 72 | C | $6.3577 | 92 | 5 | 17m 1s | |
76, Tied with 9 others | Memgraph | 72 | C | $0.3253 | 14 | 0 | 7m 41s | |
76, Tied with 9 others | Cloudflare | 72 | C | $3.7286 | 61 | 3 | 10m 57s | |
76, Tied with 9 others | Zoom AI Services | 72 | C | $1.7095 | 44 | 0 | 6m 52s | |
76, Tied with 9 others | Stability AI | 72 | C | $0.4090 | 15 | 0 | 1m 43s | |
76, Tied with 9 others | Zep | 72 | C | $2.1047 | 67 | 2 | 16m 2s | |
86, Tied with 4 others | Scrapfly | 71 | C | $0.4430 | 16 | 0 | 3m 0s | |
86, Tied with 4 others | Agora | 71 | C | $1.4348 | 47 | 0 | 25m 27s | |
86, Tied with 4 others | TABStack | 71 | C | $2.1624 | 53 | 0 | 11m 14s | |
86, Tied with 4 others | Convex | 71 | C | $1.1461 | 33 | 0 | 10m 16s | |
86, Tied with 4 others | Naive | 71 | C | $2.2534 | 61 | 0 | 19m 4s | |
91, Tied with 3 others | Zilliz Cloud | 70 | C | $0.9771 | 28 | 2 | 4m 58s | |
91, Tied with 3 others | Modal | 70 | C | $0.3543 | 18 | 1 | 2m 19s | |
91, Tied with 3 others | Tenki | 70 | C | $1.9472 | 39 | 0 | 2m 50s | |
91, Tied with 3 others | AIsa | 70 | C | $0.7073 | 29 | 1 | 3m 10s | |
95, Tied with 2 others | BoldSign | 69 | C | $0.6696 | 22 | 0 | 5m 31s | |
95, Tied with 2 others | Sprites | 69 | C | $1.3295 | 40 | 1 | 3m 56s | |
95, Tied with 2 others | Letta | 69 | C | $0.7009 | 18 | 2 | 24m 1s | |
98, Tied with 6 others | Prelude | 68 | C | $0.3855 | 16 | 0 | 1m 14s | |
98, Tied with 6 others | Jina AI | 68 | C | $1.1179 | 33 | 1 | 6m 1s | |
98, Tied with 6 others | Plivo | 68 | C | $0.8341 | 28 | 0 | 6m 35s | |
98, Tied with 6 others | Diffbot | 68 | C | $1.2619 | 27 | 0 | 4m 36s | |
98, Tied with 6 others | Railway | 68 | C | $2.4373 | 50 | 1 | 6m 46s | |
98, Tied with 6 others | PandaDoc | 68 | C | $1.0143 | 25 | 0 | 7m 27s | |
98, Tied with 6 others | Anchor Browser | 68 | C | $1.9436 | 59 | 3 | 6m 0s | |
105, Tied with 5 others | Azion | 67 | C | $3.5535 | 45 | 1 | 24m 45s | |
105, Tied with 5 others | Rev AI | 67 | C | $0.2621 | 0 | 0 | 3m 53s | |
105, Tied with 5 others | PayPal | 67 | C | $1.4529 | 28 | 1 | 14m 24s | |
105, Tied with 5 others | Twelve Labs | 67 | C | $1.4270 | 49 | 1 | 11m 41s | |
105, Tied with 5 others | TigerGraph | 67 | C | $1.2010 | 34 | 1 | 15m 6s | |
105, Tied with 5 others | Hookdeck | 67 | C | $3.3716 | 62 | 1 | 35m 49s | |
111, Tied with 2 others | Airwallex | 66 | C | $2.0094 | 43 | 0 | 11m 30s | |
111, Tied with 2 others | Meeting BaaS | 66 | C | $0.7392 | 18 | 0 | 3m 4s | |
111, Tied with 2 others | Stytch | 66 | C | $0.9289 | 39 | 0 | 2m 25s | |
114 | BetterStack | 65 | C | $1.2462 | 23 | 0 | 4m 16s | |
115, Tied with 2 others | Mollie | 64 | C | $1.7652 | 37 | 2 | 5m 49s | |
115, Tied with 2 others | LanceDB | 64 | C | $2.3724 | 49 | 2 | 5m 48s | |
115, Tied with 2 others | HitPay | 64 | C | $2.5884 | 38 | 2 | 5m 18s | |
118 | Freestyle | 63 | C | $2.2821 | 49 | 2 | 18m 22s | |
119 | Cadence | 61 | C | $2.0715 | 55 | 1 | 3m 31s | |
120, Tied with 1 other | Square | 60 | C | $0.9197 | 52 | 1 | 8m 17s | |
120, Tied with 1 other | Surge | 60 | C | $1.7545 | 53 | 1 | 5m 29s | |
122, Tied with 1 other |  AWS Step Functions | 59 | C | $4.0295 | 65 | 8 | 7m 54s | |
122, Tied with 1 other | DFNS | 59 | C | $1.1118 | 33 | 1 | 7m 26s | |
124 | Sensible | 58 | C | $4.9223 | 73 | 0 | 21m 48s | |
125 | Recall.ai | 57 | C | $0.5760 | 22 | 1 | 5m 46s | |
126 | Pioneer AI | 49 | D | $1.0941 | 35 | 0 | 25m 29s | |
127 | LemonSqueezy | 47 | D | $1.2043 | 24 | 1 | 8m 17s | |
| — | Cloudflare Workers Task needs a paid plan (Cloudflare Sandbox SDK requires Workers Paid) | — | — | — | — | — | — | |
| — | Fireblocks Phone number needed to sign up (developer sandbox form) | — | — | — | — | — | — | |
| — | Telnyx Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Ash Hosted Ash Cloud gives no working runtime on a free account (0 credits; credits from $10) | — | — | — | — | — | — | |
| — | Sonilo API key requires a paid plan | — | — | — | — | — | — | |
| — | Unstructured Unable to obtain API key | — | — | — | — | — | — | |
| — | Datadog Unable to obtain API key | — | — | — | — | — | — | |
| — | Dust API key requires a paid plan | — | — | — | — | — | — | |
| — | ElevenLabs Music Music API requires a paid plan | — | — | — | — | — | — | |
| — | Kosuke Unable to obtain API key | — | — | — | — | — | — | |
| — | Nebius Token Factory Credit card needed to sign up | — | — | — | — | — | — | |
| — | Circle Faucet API requires a Mainnet account with billing details | — | — | — | — | — | — | |
| — | Temporal Credit card required to start the free trial | — | — | — | — | — | — | |
| — | Razorpay Phone number or PAN needed before *****-mode keys | — | — | — | — | — | — | |
| — | DigitalOcean Credit card needed to sign up | — | — | — | — | — | — | |
| — | TogetherAI API key requires a paid plan | — | — | — | — | — | — | |
| — | HeyGen API key requires a paid plan | — | — | — | — | — | — | |
| — | Strapi Hosted Strapi Cloud requires a paid plan (no free plan or trial) | — | — | — | — | — | — | |
| — | Upsun Access requires vendor approval | — | — | — | — | — | — | |
| — | Perplexity API key requires a paid plan | — | — | — | — | — | — | |
| — | Chargebee Credit card or phone needed to sign up (site API answers 403 api_disabled 'site is not enabled'; new account needs phone verification) | — | — | — | — | — | — | |
| — | CocoIndex Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |
| — | Gumloop Credit card needed to sign up | — | — | — | — | — | — | |
| — | Relevance AI API key requires a paid plan | — | — | — | — | — | — | |
| — | Replicate API key requires a paid plan | — | — | — | — | — | — | |
| — | Bargo Access requires vendor approval | — | — | — | — | — | — | |
| — | Massive Proxy access requires KYC verification | — | — | — | — | — | — | |
| — | Bandwidth Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | DeepInfra API key requires a paid plan | — | — | — | — | — | — | |
| — | Sinch Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | SambaNova API key requires a paid plan | — | — | — | — | — | — | |
| — | Adyen Phone number needed to sign up for a ***** account | — | — | — | — | — | — | |
| — | Resemble AI API key requires a paid plan | — | — | — | — | — | — | |
| — | Kite No API key offered (passkey Passport and CLI only) | — | — | — | — | — | — | |
| — | Ravion Task needs a connected AWS account (card and phone required); only aws-main in AWAITING_CONNECTION, pipeline fails Ravion:AwsAccount:NOT_CONNECTED | — | — | — | — | — | — | |
| — | Mubert API key requires a paid plan | — | — | — | — | — | — | |
| — | Visa Payment-link API requires Visa approval | — | — | — | — | — | — | |
| — | Cerebras Credit card required to activate API access | — | — | — | — | — | — | |
| — | Infobip Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Macroscope Credit card needed to sign up | — | — | — | — | — | — | |
| — | Entrig Task needs a paid plan (Entrig sends SMS only on its $100/month plan) | — | — | — | — | — | — | |
| — | GovSpend Access requires vendor approval | — | — | — | — | — | — | |
| — | MeetGeek Task needs a paid plan (bot join requires a paid subscription) | — | — | — | — | — | — | |
| — | Brave Search Credit card needed to sign up | — | — | — | — | — | — | |
| — | 100ms Credit card required to access API keys | — | — | — | — | — | — | |
| — | Roster No API key configured for this company | — | — | — | — | — | — | |
| — | Pursuit API requires a paid subscription arranged through a sales meeting | — | — | — | — | — | — | |
| — | Google Lyria API key requires a paid plan | — | — | — | — | — | — | |
| — | Apollo Required API access is excluded from free and trial plans | — | — | — | — | — | — | |
| — | Loudly API key requires a paid plan | — | — | — | — | — | — | |
| — | NationGraph Unable to obtain API key | — | — | — | — | — | — | |
| — | Unclone Access requires vendor approval | — | — | — | — | — | — | |
| — | Triple-A Sandbox access requires a reviewed business inquiry | — | — | — | — | — | — | |
| — | LMNT No longer in service | — | — | — | — | — | — | |
| — |  CueMeet Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |
| — | RampRadar API keys are not self-serve (request through the Contact page) | — | — | — | — | — | — |
Scores calculated from evaluations by AI coding agents across multiple benchmarks.
Frequently asked questions
Join the mailing list
Get updates on leaderboard changes, new benchmark releases, and product announcements.