LightsageClickTap any row to explore the full eval.
Get your API graded →
| Rank | Tool | Score | Grade | Cost | Calls | Errors | Time | Report |
|---|---|---|---|---|---|---|---|---|
🥇 | Deepgram | 93 | A | $0.0010 | 6 | 0 | 44s | |
🥇 | Weaviate | 93 | A | $0.0014 | 10 | 0 | 37s | |
🥇 | Prefect | 93 | A | $0.0007 | 7 | 0 | 41s | |
🥇 | Reducto | 93 | A | $0.0012 | 9 | 0 | 36s | |
🥇 | LlamaParse | 93 | A | $0.0009 | 8 | 0 | 35s | |
🥇 | ElevenLabs | 93 | A | $0.0006 | 6 | 0 | 43s | |
7 | Rime | 92 | A | $0.0009 | 8 | 0 | 29s | |
8, Tied with 3 others | Postman | 90 | A | $0.0014 | 13 | 0 | 43s | |
8, Tied with 3 others | Netflix Conductor | 90 | A | $0.0011 | 19 | 0 | 36s | |
8, Tied with 3 others | E2B | 90 | A | $0.0009 | 13 | 0 | 48s | |
8, Tied with 3 others | Stability AI | 90 | A | $0.0013 | 12 | 0 | 32s | |
12, Tied with 1 other | Stripe | 89 | B | $0.0008 | 8 | 1 | 56s | |
12, Tied with 1 other | Fireworks AI | 89 | B | $0.0008 | 7 | 1 | 30s | |
14, Tied with 5 others | AssemblyAI | 88 | B | $0.0016 | 11 | 0 | 1m 1s | |
14, Tied with 5 others | OpenCageData | 88 | B | $0.0011 | 10 | 0 | 47s | |
14, Tied with 5 others | Tavily | 88 | B | $0.0013 | 11 | 0 | 1m 4s | |
14, Tied with 5 others | Vonage | 88 | B | $0.0011 | 9 | 0 | 37s | |
14, Tied with 5 others | CockroachDB | 88 | B | $0.0157 | 7 | 0 | 38s | |
14, Tied with 5 others | FalkorDB | 88 | B | $0.0025 | 10 | 0 | 54s | |
20, Tied with 7 others | WorkOS | 87 | B | $0.0012 | 12 | 1 | 51s | |
20, Tied with 7 others | Agentmail | 87 | B | $0.0011 | 12 | 1 | 36s | |
20, Tied with 7 others | Clerk | 87 | B | $0.0013 | 13 | 1 | 41s | |
20, Tied with 7 others | Qdrant | 87 | B | $0.0013 | 14 | 2 | 50s | |
20, Tied with 7 others | Meetstream | 87 | B | $0.0011 | 12 | 0 | 34s | |
20, Tied with 7 others | Dropbox | 87 | B | $0.0013 | 17 | 0 | 1m 9s | |
20, Tied with 7 others | Superserve | 87 | B | $0.0009 | 13 | 1 | 32s | |
20, Tied with 7 others | fastCRW | 87 | B | $0.0012 | 14 | 1 | 48s | |
28, Tied with 4 others | Zernio | 86 | B | $0.0023 | 19 | 0 | 43s | |
28, Tied with 4 others | Mesh API | 86 | B | $0.0021 | 13 | 0 | 53s | |
28, Tied with 4 others | Apify | 86 | B | $0.0196 | 17 | 0 | 1m 36s | |
28, Tied with 4 others | Jina AI | 86 | B | $0.0019 | 18 | 0 | 2m 4s | |
28, Tied with 4 others | Steel | 86 | B | $0.0038 | 22 | 0 | 1m 7s | |
33, Tied with 1 other | Auth0 | 85 | B | $0.0019 | 10 | 1 | 44s | |
33, Tied with 1 other | Neo4j | 85 | B | $0.0009 | 8 | 1 | 30s | |
35, Tied with 6 others | Scrapfly | 84 | B | $0.0015 | 8 | 0 | 35s | |
35, Tied with 6 others | Groq | 84 | B | $0.0008 | 8 | 0 | 24s | |
35, Tied with 6 others | Bolna | 84 | B | $0.0014 | 14 | 0 | 1m 5s | |
35, Tied with 6 others | OpenRouter | 84 | B | $0.0010 | 11 | 1 | 1m 18s | |
35, Tied with 6 others | You.com | 84 | B | $0.0016 | 15 | 1 | 1m 25s | |
35, Tied with 6 others | Chroma | 84 | B | $0.0010 | 12 | 2 | 1m 6s | |
35, Tied with 6 others | Daytona | 84 | B | $0.0013 | 15 | 2 | 1m 14s | |
42, Tied with 12 others | Mollie | 83 | B | $0.0018 | 12 | 1 | 53s | |
42, Tied with 12 others | Tavus | 83 | B | $0.0018 | 23 | 0 | 4m 23s | |
42, Tied with 12 others | Descope | 83 | B | $0.0016 | 19 | 2 | 1m 1s | |
42, Tied with 12 others | Pinecone | 83 | B | $0.0013 | 16 | 2 | 1m 7s | |
42, Tied with 12 others | Netlify | 83 | B | $0.0039 | 28 | 0 | 3m 41s | |
42, Tied with 12 others | Box | 83 | B | $0.0020 | 23 | 5 | 1m 9s | |
42, Tied with 12 others | Extend.ai | 83 | B | $0.0010 | 12 | 0 | 1m 5s | |
42, Tied with 12 others | Speechify | 83 | B | $0.0014 | 14 | 2 | 51s | |
42, Tied with 12 others | Memgraph | 83 | B | $0.0012 | 15 | 2 | 41s | |
42, Tied with 12 others | Merge Gateway | 83 | B | $0.0015 | 18 | 2 | 1m 28s | |
42, Tied with 12 others | Cloudflare | 83 | B | $0.0046 | 36 | 0 | 3m 40s | |
42, Tied with 12 others | Vercel | 83 | B | $0.0016 | 19 | 3 | 1m 3s | |
42, Tied with 12 others | Mem0 | 83 | B | $0.0048 | 25 | 0 | 3m 11s | |
55, Tied with 7 others | Diagrid | 82 | B | $0.0218 | 21 | 0 | 1m 4s | |
55, Tied with 7 others | Speechmatics | 82 | B | $0.0012 | 12 | 0 | 46s | |
55, Tied with 7 others | Nebius AI Cloud | 82 | B | $0.0018 | 23 | 0 | 1m 3s | |
55, Tied with 7 others | Twilio | 82 | B | $0.0036 | 19 | 4 | 2m 29s | |
55, Tied with 7 others | OpenAI Whisper | 82 | B | $0.0015 | 8 | 1 | 1m 3s | |
55, Tied with 7 others | Naive | 82 | B | $0.0011 | 10 | 1 | 1m 5s | |
55, Tied with 7 others | Anchor Browser | 82 | B | $0.0018 | 21 | 0 | 1m 29s | |
55, Tied with 7 others | Zep | 82 | B | $0.0037 | 42 | 0 | 9m 17s | |
63, Tied with 5 others | Cartesia | 81 | B | $0.0013 | 21 | 3 | 54s | |
63, Tied with 5 others | Paddle | 81 | B | $0.0038 | 42 | 4 | 1m 47s | |
63, Tied with 5 others | Resend | 81 | B | $0.0033 | 34 | 2 | 2m 15s | |
63, Tied with 5 others | Scalekit | 81 | B | $0.0043 | 34 | 4 | 1m 36s | |
63, Tied with 5 others | Nimble | 81 | B | $0.0030 | 25 | 0 | 2m 20s | |
63, Tied with 5 others | Mux | 81 | B | $0.0028 | 28 | 2 | 2m 19s | |
69, Tied with 1 other | Modal | 80 | B | $0.0019 | 8 | 1 | 37s | |
69, Tied with 1 other | AIsa | 80 | B | $0.0013 | 14 | 1 | 1m 5s | |
71, Tied with 17 others | VideoDB | 79 | B | $0.0019 | 24 | 1 | 6m 38s | |
71, Tied with 17 others | Shopware | 79 | B | $0.0048 | 45 | 3 | 3m 36s | |
71, Tied with 17 others | Pipecat | 79 | B | $0.0153 | 31 | 1 | 3m 19s | |
71, Tied with 17 others | Render | 79 | B | $0.0018 | 27 | 1 | 2m 58s | |
71, Tied with 17 others | Firecrawl | 79 | B | $0.0034 | 39 | 2 | 5m 24s | |
71, Tied with 17 others | Merge | 79 | B | $0.0038 | 38 | 1 | 4m 54s | |
71, Tied with 17 others | TABStack | 79 | B | $0.0041 | 34 | 0 | 4m 10s | |
71, Tied with 17 others | Diffbot | 79 | B | $0.0010 | 14 | 0 | 1m 1s | |
71, Tied with 17 others | Convex | 79 | B | $0.0021 | 23 | 1 | 1m 26s | |
71, Tied with 17 others | Restate | 79 | B | $0.0055 | 65 | 4 | 8m 20s | |
71, Tied with 17 others | Vapi | 79 | B | $0.0049 | 43 | 1 | 5m 29s | |
71, Tied with 17 others | Browser Use | 79 | B | $0.0030 | 34 | 2 | 2m 48s | |
71, Tied with 17 others | Coinbase Payments | 79 | B | $0.0067 | 24 | 0 | 5m 20s | |
71, Tied with 17 others | Blaxel | 79 | B | $0.0021 | 17 | 4 | 1m 5s | |
71, Tied with 17 others | Camunda | 79 | B | $0.0116 | 74 | 6 | 8m 47s | |
71, Tied with 17 others | Hookdeck | 79 | B | $0.0025 | 30 | 0 | 2m 38s | |
71, Tied with 17 others | Oodle | 79 | B | $0.0045 | 54 | 1 | 2m 41s | |
71, Tied with 17 others | Google DeepMind | 79 | B | $0.0010 | 15 | 1 | 2m 1s | |
89, Tied with 3 others | TinyFish | 78 | B | $0.0045 | 19 | 1 | 1m 56s | |
89, Tied with 3 others | Sprites | 78 | B | $0.0024 | 38 | 4 | 1m 19s | |
89, Tied with 3 others | Tenki | 78 | B | $0.0013 | 15 | 1 | 56s | |
89, Tied with 3 others | Zoom AI Services | 78 | B | $0.0026 | 40 | 3 | 1m 24s | |
93, Tied with 4 others | Zilliz Cloud | 77 | B | $0.0047 | 23 | 1 | 1m 36s | |
93, Tied with 4 others | Meeting BaaS | 77 | B | $0.0033 | 17 | 0 | 58s | |
93, Tied with 4 others | PayPal | 77 | B | $0.0019 | 24 | 3 | 1m 41s | |
93, Tied with 4 others | Exa | 77 | B | $0.0044 | 21 | 2 | 1m 46s | |
93, Tied with 4 others | CopilotKit | 77 | B | $0.0018 | 21 | 3 | 1m 30s | |
98, Tied with 2 others | LiveKit | 76 | B | $0.0074 | 23 | 6 | 3m 28s | |
98, Tied with 2 others | Nylas | 76 | B | $0.0035 | 32 | 3 | 1m 55s | |
98, Tied with 2 others | Cognee | 76 | B | $0.0549 | 78 | 5 | 18m 2s | |
101, Tied with 4 others | Vectoree | 75 | B | $0.0116 | 10 | 0 | 37s | |
101, Tied with 4 others | LanceDB | 75 | B | $0.0015 | 15 | 1 | 1m 26s | |
101, Tied with 4 others | Rev AI | 75 | B | $0.0014 | 10 | 0 | 1m 43s | |
101, Tied with 4 others | Airwallex | 75 | B | $0.0038 | 37 | 1 | 2m 41s | |
101, Tied with 4 others | Twelve Labs | 75 | B | $0.0035 | 38 | 6 | 3m 48s | |
106, Tied with 6 others | BoldSign | 74 | C | $0.0036 | 25 | 1 | 1m 7s | |
106, Tied with 6 others | BlindPay | 74 | C | $0.0140 | 58 | 7 | 5m 30s | |
106, Tied with 6 others | Agora | 74 | C | $0.0169 | 83 | 5 | 7m 43s | |
106, Tied with 6 others | Plivo | 74 | C | $0.0021 | 25 | 4 | 1m 7s | |
106, Tied with 6 others | Apideck | 74 | C | $0.0077 | 69 | 5 | 8m 16s | |
106, Tied with 6 others | TigerGraph | 74 | C | $0.0102 | 58 | 2 | 8m 24s | |
106, Tied with 6 others | Letta | 74 | C | $0.0062 | 41 | 4 | 6m 55s | |
113, Tied with 3 others | Prelude | 73 | C | $0.0014 | 13 | 0 | 52s | |
113, Tied with 3 others | Surge | 73 | C | $0.0020 | 23 | 6 | 2m 16s | |
113, Tied with 3 others | HitPay | 73 | C | $0.0026 | 23 | 1 | 1m 48s | |
113, Tied with 3 others | Orkes | 73 | C | $0.0289 | 30 | 3 | 1m 0s | |
117 | Freestyle | 72 | C | $0.0030 | 31 | 2 | 2m 10s | |
118 | DFNS | 71 | C | $0.0039 | 27 | 0 | 2m 23s | |
119 | BetterStack | 70 | C | $0.0045 | 29 | 0 | 4m 22s | |
120 | Square | 69 | C | $0.0017 | 28 | 9 | 1m 27s | |
121, Tied with 1 other | Stytch | 68 | C | $0.0019 | 30 | 2 | 1m 57s | |
121, Tied with 1 other | Recall.ai | 68 | C | $0.0018 | 22 | 1 | 59s | |
123 | Cadence | 66 | C | $0.0029 | 44 | 7 | 3m 21s | |
124 | LemonSqueezy | 64 | C | $0.0044 | 18 | 0 | 1m 50s | |
125 | Sensible | 61 | C | $0.0130 | 79 | 6 | 9m 20s | |
126 | Celigo | 59 | C | $0.5745 | 146 | 11 | 18m 47s | |
127 | WSO2 Asgardeo | 52 | D | $0.1244 | 61 | 6 | 11m 53s | |
| — | Cloudflare Workers Task needs a paid plan (Cloudflare Sandbox SDK requires Workers Paid) | — | — | — | — | — | — | |
| — | Fireblocks Phone number needed to sign up (developer sandbox form) | — | — | — | — | — | — | |
| — | Telnyx Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Ash Hosted Ash Cloud gives no working runtime on a free account (0 credits; credits from $10) | — | — | — | — | — | — | |
| — | Sonilo API key requires a paid plan | — | — | — | — | — | — | |
| — | Unstructured Unable to obtain API key | — | — | — | — | — | — | |
| — | Datadog Unable to obtain API key | — | — | — | — | — | — | |
| — | Dust API key requires a paid plan | — | — | — | — | — | — | |
| — | ElevenLabs Music Music API requires a paid plan | — | — | — | — | — | — | |
| — | Kosuke Unable to obtain API key | — | — | — | — | — | — | |
| — | Azion CLI build and deploy outlast the harness's no-output timeout | — | — | — | — | — | — | |
| — | Nebius Token Factory Credit card needed to sign up | — | — | — | — | — | — | |
| — | Circle Faucet API requires a Mainnet account with billing details | — | — | — | — | — | — | |
| — | Temporal Credit card required to start the free trial | — | — | — | — | — | — | |
| — | Razorpay Phone number or PAN needed before *****-mode keys | — | — | — | — | — | — | |
| — | DigitalOcean Credit card needed to sign up | — | — | — | — | — | — | |
| — | TogetherAI API key requires a paid plan | — | — | — | — | — | — | |
| — | HeyGen API key requires a paid plan | — | — | — | — | — | — | |
| — | Strapi Hosted Strapi Cloud requires a paid plan (no free plan or trial) | — | — | — | — | — | — | |
| — | Upsun Access requires vendor approval | — | — | — | — | — | — | |
| — | Perplexity API key requires a paid plan | — | — | — | — | — | — | |
| — | Chargebee Credit card or phone needed to sign up (site API answers 403 api_disabled 'site is not enabled'; new account needs phone verification) | — | — | — | — | — | — | |
| — | CocoIndex Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |
| — | Gumloop Credit card needed to sign up | — | — | — | — | — | — | |
| — | Relevance AI API key requires a paid plan | — | — | — | — | — | — | |
| — | Replicate API key requires a paid plan | — | — | — | — | — | — | |
| — | Bargo Access requires vendor approval | — | — | — | — | — | — | |
| — | Massive Proxy access requires KYC verification | — | — | — | — | — | — | |
| — | Bandwidth Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | DeepInfra API key requires a paid plan | — | — | — | — | — | — | |
| — | Daily Task forbids raw REST, and Daily's Python SDK has no room or token methods | — | — | — | — | — | — | |
| — | Sinch Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Docusign Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | SambaNova API key requires a paid plan | — | — | — | — | — | — | |
| — | Adyen Phone number needed to sign up for a ***** account | — | — | — | — | — | — | |
| — | PandaDoc API trial used up; new accounts are suspended at signup | — | — | — | — | — | — | |
| — | Resemble AI API key requires a paid plan | — | — | — | — | — | — | |
| — | Kite No API key offered (passkey Passport and CLI only) | — | — | — | — | — | — | |
| — | Ravion Task needs a connected AWS account (card and phone required); only aws-main in AWAITING_CONNECTION, pipeline fails Ravion:AwsAccount:NOT_CONNECTED | — | — | — | — | — | — | |
| — | Mubert API key requires a paid plan | — | — | — | — | — | — | |
| — | Visa Payment-link API requires Visa approval | — | — | — | — | — | — | |
| — | Cerebras Credit card required to activate API access | — | — | — | — | — | — | |
| — |  AWS Step Functions Free sandbox account expired; a new one can be requested once a week | — | — | — | — | — | — | |
| — | Infobip Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Akka Task needs a Python SDK; Akka's SDK is Java only | — | — | — | — | — | — | |
| — | Macroscope Credit card needed to sign up | — | — | — | — | — | — | |
| — | Entrig Task needs a paid plan (Entrig sends SMS only on its $100/month plan) | — | — | — | — | — | — | |
| — | Allo Task needs a Python SDK and outbound calls, which Allo doesn't offer | — | — | — | — | — | — | |
| — | GovSpend Access requires vendor approval | — | — | — | — | — | — | |
| — | MeetGeek Task needs a paid plan (bot join requires a paid subscription) | — | — | — | — | — | — | |
| — | Brave Search Credit card needed to sign up | — | — | — | — | — | — | |
| — | 100ms Credit card required to access API keys | — | — | — | — | — | — | |
| — | Pioneer AI Credits required to create an API key (paid) | — | — | — | — | — | — | |
| — | Roster No API key configured for this company | — | — | — | — | — | — | |
| — | Pursuit API requires a paid subscription arranged through a sales meeting | — | — | — | — | — | — | |
| — | Google Lyria API key requires a paid plan | — | — | — | — | — | — | |
| — | Apollo Required API access is excluded from free and trial plans | — | — | — | — | — | — | |
| — | Loudly API key requires a paid plan | — | — | — | — | — | — | |
| — | NationGraph Unable to obtain API key | — | — | — | — | — | — | |
| — | Unclone Access requires vendor approval | — | — | — | — | — | — | |
| — | Triple-A Sandbox access requires a reviewed business inquiry | — | — | — | — | — | — | |
| — | LMNT No longer in service | — | — | — | — | — | — | |
| — |  CueMeet Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |
| — | RampRadar API keys are not self-serve (request through the Contact page) | — | — | — | — | — | — |
Scores calculated from evaluations by AI coding agents across multiple benchmarks.
Frequently asked questions
Join the mailing list
Get updates on leaderboard changes, new benchmark releases, and product announcements.