LightsageClickTap any row to explore the full eval.
Get your API graded →
| Rank | Tool | Score | Grade | Cost | Calls | Errors | Time | Report |
|---|---|---|---|---|---|---|---|---|
🥇 | Postman | 93 | A | $0.00 | 9 | 0 | 41s | |
🥇 | Stripe | 93 | A | $0.00 | 8 | 0 | 38s | |
🥇 | Fireworks AI | 93 | A | $0.00 | 8 | 0 | 36s | |
🥇 | AssemblyAI | 93 | A | $0.00 | 8 | 0 | 59s | |
🥇 | Prefect | 93 | A | $0.00 | 9 | 0 | 55s | |
6 | Vercel | 90 | A | $0.00 | 10 | 0 | 1m 8s | |
7, Tied with 1 other | Deepgram | 89 | B | $0.00 | 10 | 3 | 46s | |
7, Tied with 1 other | ElevenLabs | 89 | B | $0.00 | 9 | 1 | 41s | |
9, Tied with 8 others | Pipecat | 88 | B | $0.00 | 15 | 0 | 1m 22s | |
9, Tied with 8 others | Airwallex | 88 | B | $0.00 | 9 | 0 | 39s | |
9, Tied with 8 others | Clerk | 88 | B | $0.00 | 11 | 0 | 1m 0s | |
9, Tied with 8 others | Dropbox | 88 | B | $0.00 | 8 | 0 | 40s | |
9, Tied with 8 others | Rime | 88 | B | $0.00 | 8 | 0 | 48s | |
9, Tied with 8 others | Tavily | 88 | B | $0.00 | 11 | 0 | 1m 6s | |
9, Tied with 8 others | LlamaParse | 88 | B | $0.00 | 12 | 0 | 1m 5s | |
9, Tied with 8 others | Merge Gateway | 88 | B | $0.00 | 11 | 0 | 1m 23s | |
9, Tied with 8 others | Steel | 88 | B | $0.00 | 12 | 0 | 1m 20s | |
18, Tied with 5 others | Agentmail | 87 | B | $0.00 | 14 | 1 | 58s | |
18, Tied with 5 others | Weaviate | 87 | B | $0.00 | 11 | 1 | 52s | |
18, Tied with 5 others | OpenRouter | 87 | B | $0.00 | 11 | 1 | 35s | |
18, Tied with 5 others | E2B | 87 | B | $0.00 | 14 | 1 | 55s | |
18, Tied with 5 others | Box | 87 | B | $0.00 | 19 | 0 | 1m 27s | |
18, Tied with 5 others | Stability AI | 87 | B | $0.00 | 11 | 1 | 44s | |
24, Tied with 1 other | Mesh API | 86 | B | $0.00 | 16 | 0 | 57s | |
24, Tied with 1 other | Descope | 86 | B | $0.00 | 25 | 0 | 1m 0s | |
26, Tied with 5 others | WorkOS | 85 | B | $0.00 | 15 | 1 | 1m 21s | |
26, Tied with 5 others | Qdrant | 85 | B | $0.00 | 13 | 3 | 1m 9s | |
26, Tied with 5 others | Pinecone | 85 | B | $0.00 | 15 | 1 | 1m 6s | |
26, Tied with 5 others | OpenCageData | 85 | B | $0.00 | 8 | 1 | 40s | |
26, Tied with 5 others | Daytona | 85 | B | $0.00 | 15 | 1 | 1m 27s | |
26, Tied with 5 others | Neo4j | 85 | B | $0.00 | 10 | 2 | 50s | |
32, Tied with 6 others | Scrapfly | 84 | B | $0.00 | 7 | 0 | 46s | |
32, Tied with 6 others | TinyFish | 84 | B | $0.00 | 10 | 0 | 1m 34s | |
32, Tied with 6 others | Netlify | 84 | B | $0.00 | 25 | 0 | 2m 44s | |
32, Tied with 6 others | CockroachDB | 84 | B | $0.01 | 6 | 0 | 31s | |
32, Tied with 6 others | Reducto | 84 | B | $0.00 | 17 | 1 | 1m 6s | |
32, Tied with 6 others | fastCRW | 84 | B | $0.00 | 19 | 1 | 1m 14s | |
32, Tied with 6 others | Memgraph | 84 | B | $0.00 | 8 | 0 | 37s | |
39, Tied with 6 others | Render | 83 | B | $0.00 | 28 | 0 | 4m 16s | |
39, Tied with 6 others | Merge | 83 | B | $0.00 | 30 | 0 | 4m 10s | |
39, Tied with 6 others | Meetstream | 83 | B | $0.00 | 17 | 0 | 1m 21s | |
39, Tied with 6 others | Bolna | 83 | B | $0.00 | 11 | 1 | 58s | |
39, Tied with 6 others | Vonage | 83 | B | $0.00 | 11 | 0 | 1m 7s | |
39, Tied with 6 others | FalkorDB | 83 | B | $0.00 | 14 | 1 | 55s | |
39, Tied with 6 others | Zep | 83 | B | $0.00 | 28 | 0 | 4m 48s | |
46, Tied with 6 others | Zernio | 82 | B | $0.00 | 16 | 1 | 44s | |
46, Tied with 6 others | Zilliz Cloud | 82 | B | $0.00 | 11 | 0 | 1m 39s | |
46, Tied with 6 others | Netflix Conductor | 82 | B | $0.00 | 8 | 1 | 39s | |
46, Tied with 6 others | Convex | 82 | B | $0.00 | 22 | 0 | 1m 23s | |
46, Tied with 6 others | Chroma | 82 | B | $0.00 | 18 | 3 | 1m 50s | |
46, Tied with 6 others | Speechify | 82 | B | $0.00 | 18 | 1 | 52s | |
46, Tied with 6 others | AIsa | 82 | B | $0.00 | 22 | 0 | 1m 22s | |
53, Tied with 6 others | Firecrawl | 81 | B | $0.00 | 25 | 3 | 1m 32s | |
53, Tied with 6 others | Paddle | 81 | B | $0.00 | 27 | 3 | 1m 47s | |
53, Tied with 6 others | Resend | 81 | B | $0.00 | 41 | 2 | 2m 5s | |
53, Tied with 6 others | Apify | 81 | B | $0.02 | 32 | 6 | 2m 4s | |
53, Tied with 6 others | Superserve | 81 | B | $0.00 | 27 | 5 | 2m 13s | |
53, Tied with 6 others | OpenAI Whisper | 81 | B | $0.00 | 6 | 0 | 59s | |
53, Tied with 6 others | Browserbase | 81 | B | $0.00 | 23 | 1 | 2m 7s | |
60, Tied with 12 others | Shopware | 80 | B | $0.00 | 41 | 4 | 3m 28s | |
60, Tied with 12 others | Speechmatics | 80 | B | $0.00 | 10 | 1 | 45s | |
60, Tied with 12 others | Tavus | 80 | B | $0.00 | 18 | 1 | 6m 30s | |
60, Tied with 12 others | Groq | 80 | B | $0.00 | 8 | 0 | 43s | |
60, Tied with 12 others | Scalekit | 80 | B | $0.01 | 37 | 3 | 2m 31s | |
60, Tied with 12 others | Jina AI | 80 | B | $0.01 | 27 | 1 | 4m 20s | |
60, Tied with 12 others | You.com | 80 | B | $0.00 | 29 | 2 | 2m 35s | |
60, Tied with 12 others | Restate | 80 | B | $0.01 | 52 | 1 | 3m 52s | |
60, Tied with 12 others | Nylas | 80 | B | $0.00 | 26 | 0 | 2m 0s | |
60, Tied with 12 others | Browser Use | 80 | B | $0.00 | 31 | 2 | 3m 19s | |
60, Tied with 12 others | Orkes | 80 | B | $0.01 | 9 | 1 | 38s | |
60, Tied with 12 others | Mux | 80 | B | $0.00 | 32 | 1 | 2m 38s | |
60, Tied with 12 others | Cloudflare | 80 | B | $0.00 | 41 | 6 | 4m 0s | |
73, Tied with 14 others | Mollie | 79 | B | $0.01 | 15 | 0 | 1m 21s | |
73, Tied with 14 others | VideoDB | 79 | B | $0.00 | 32 | 2 | 7m 17s | |
73, Tied with 14 others | Cartesia | 79 | B | $0.00 | 16 | 3 | 1m 9s | |
73, Tied with 14 others | Auth0 | 79 | B | $0.00 | 17 | 1 | 1m 8s | |
73, Tied with 14 others | Twilio | 79 | B | $0.01 | 32 | 6 | 5m 2s | |
73, Tied with 14 others | Railway | 79 | B | $0.01 | 38 | 4 | 17m 52s | |
73, Tied with 14 others | Vapi | 79 | B | $0.01 | 33 | 1 | 14m 41s | |
73, Tied with 14 others | Exa | 79 | B | $0.00 | 17 | 2 | 1m 22s | |
73, Tied with 14 others | Blaxel | 79 | B | $0.00 | 19 | 3 | 1m 20s | |
73, Tied with 14 others | Cognee | 79 | B | $0.01 | 34 | 6 | 6m 19s | |
73, Tied with 14 others | Naive | 79 | B | $0.00 | 16 | 1 | 1m 19s | |
73, Tied with 14 others | Extend.ai | 79 | B | $0.00 | 16 | 3 | 1m 0s | |
73, Tied with 14 others | Camunda | 79 | B | $0.01 | 64 | 4 | 7m 49s | |
73, Tied with 14 others | Mem0 | 79 | B | $0.00 | 30 | 1 | 6m 20s | |
73, Tied with 14 others | Oodle | 79 | B | $0.01 | 47 | 1 | 5m 40s | |
88, Tied with 3 others | Diffbot | 78 | B | $0.00 | 13 | 1 | 50s | |
88, Tied with 3 others | HitPay | 78 | B | $0.00 | 20 | 0 | 1m 13s | |
88, Tied with 3 others | Coinbase Payments | 78 | B | $0.00 | 20 | 2 | 1m 43s | |
88, Tied with 3 others | Zoom AI Services | 78 | B | $0.00 | 18 | 5 | 1m 40s | |
92, Tied with 3 others | Sprites | 77 | B | $0.00 | 25 | 3 | 2m 12s | |
92, Tied with 3 others | Twelve Labs | 77 | B | $0.00 | 19 | 1 | 2m 31s | |
92, Tied with 3 others | CopilotKit | 77 | B | $0.00 | 21 | 1 | 1m 31s | |
92, Tied with 3 others | Google DeepMind | 77 | B | $0.00 | 13 | 1 | 5m 52s | |
96, Tied with 5 others | Diagrid | 76 | B | $0.04 | 29 | 1 | 1m 38s | |
96, Tied with 5 others | Nebius AI Cloud | 76 | B | $0.00 | 26 | 1 | 1m 53s | |
96, Tied with 5 others | Agora | 76 | B | $0.01 | 25 | 1 | 2m 31s | |
96, Tied with 5 others | TABStack | 76 | B | $0.00 | 22 | 2 | 2m 30s | |
96, Tied with 5 others | PayPal | 76 | B | $0.00 | 23 | 1 | 2m 32s | |
96, Tied with 5 others | Anchor Browser | 76 | B | $0.00 | 23 | 1 | 2m 44s | |
102, Tied with 5 others | BlindPay | 75 | B | $0.00 | 43 | 1 | 3m 43s | |
102, Tied with 5 others | Meeting BaaS | 75 | B | $0.00 | 13 | 0 | 1m 11s | |
102, Tied with 5 others | Nimble | 75 | B | $0.00 | 32 | 1 | 2m 32s | |
102, Tied with 5 others | Modal | 75 | B | $0.00 | 17 | 6 | 1m 9s | |
102, Tied with 5 others | Letta | 75 | B | $0.00 | 23 | 2 | 5m 25s | |
102, Tied with 5 others | Hookdeck | 75 | B | $0.01 | 35 | 1 | 4m 16s | |
108, Tied with 5 others | LanceDB | 74 | C | $0.00 | 15 | 1 | 1m 35s | |
108, Tied with 5 others | LiveKit | 74 | C | $0.00 | 26 | 1 | 7m 28s | |
108, Tied with 5 others | BoldSign | 74 | C | $0.00 | 24 | 1 | 1m 28s | |
108, Tied with 5 others | Docusign | 74 | C | $0.00 | 15 | 1 | 1m 32s | |
108, Tied with 5 others | TigerGraph | 74 | C | $0.01 | 58 | 4 | 11m 47s | |
108, Tied with 5 others | Tenki | 74 | C | $0.00 | 21 | 3 | 1m 24s | |
114, Tied with 1 other | Plivo | 72 | C | $0.00 | 32 | 2 | 2m 3s | |
114, Tied with 1 other | Stytch | 72 | C | $0.00 | 14 | 2 | 1m 0s | |
116 | Surge | 71 | C | $0.00 | 29 | 2 | 3m 6s | |
117, Tied with 2 others | Rev AI | 70 | C | $0.00 | 14 | 1 | 2m 2s | |
117, Tied with 2 others | Prelude | 70 | C | $0.00 | 12 | 1 | 52s | |
117, Tied with 2 others | BetterStack | 70 | C | $0.01 | 33 | 0 | 3m 9s | |
120, Tied with 1 other | Recall.ai | 68 | C | $0.00 | 18 | 0 | 1m 31s | |
120, Tied with 1 other | Square | 68 | C | $0.00 | 27 | 1 | 1m 30s | |
122, Tied with 1 other | DFNS | 67 | C | $0.01 | 36 | 1 | 2m 54s | |
122, Tied with 1 other | Cadence | 67 | C | $0.01 | 47 | 4 | 2m 34s | |
124 | Vectoree | 66 | C | $0.02 | 18 | 1 | 1m 20s | |
125, Tied with 2 others | LemonSqueezy | 62 | C | $0.00 | 15 | 1 | 1m 31s | |
125, Tied with 2 others | Sensible | 62 | C | $0.01 | 40 | 4 | 4m 42s | |
125, Tied with 2 others | Pioneer AI | 62 | C | $0.01 | 35 | 1 | 3m 49s | |
128 | Workato | 61 | C | $0.15 | 66 | 3 | 10m 2s | |
129 | Celigo | 60 | C | $0.23 | 87 | 3 | 13m 47s | |
130 | Apideck | 50 | D | $0.00 | 44 | 3 | 50m 42s | |
| — | Cloudflare Workers Task needs a paid plan (Cloudflare Sandbox SDK requires Workers Paid) | — | — | — | — | — | — | |
| — | Fireblocks Phone number needed to sign up (developer sandbox form) | — | — | — | — | — | — | |
| — | Telnyx Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Ash Hosted Ash Cloud gives no working runtime on a free account (0 credits; credits from $10) | — | — | — | — | — | — | |
| — | Sonilo API key requires a paid plan | — | — | — | — | — | — | |
| — | Unstructured Unable to obtain API key | — | — | — | — | — | — | |
| — | Datadog Unable to obtain API key | — | — | — | — | — | — | |
| — | Dust API key requires a paid plan | — | — | — | — | — | — | |
| — | ElevenLabs Music Music API requires a paid plan | — | — | — | — | — | — | |
| — | Kosuke Unable to obtain API key | — | — | — | — | — | — | |
| — | Azion CLI build and deploy outlast the harness's no-output timeout | — | — | — | — | — | — | |
| — | Nebius Token Factory Credit card needed to sign up | — | — | — | — | — | — | |
| — | Circle Faucet API requires a Mainnet account with billing details | — | — | — | — | — | — | |
| — | Temporal Credit card required to start the free trial | — | — | — | — | — | — | |
| — | Razorpay Phone number or PAN needed before *****-mode keys | — | — | — | — | — | — | |
| — | DigitalOcean Credit card needed to sign up | — | — | — | — | — | — | |
| — | TogetherAI API key requires a paid plan | — | — | — | — | — | — | |
| — | HeyGen API key requires a paid plan | — | — | — | — | — | — | |
| — | Strapi Hosted Strapi Cloud requires a paid plan (no free plan or trial) | — | — | — | — | — | — | |
| — | Upsun Access requires vendor approval | — | — | — | — | — | — | |
| — | Perplexity API key requires a paid plan | — | — | — | — | — | — | |
| — | Chargebee Credit card or phone needed to sign up (site API answers 403 api_disabled 'site is not enabled'; new account needs phone verification) | — | — | — | — | — | — | |
| — | CocoIndex Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |
| — | Gumloop Credit card needed to sign up | — | — | — | — | — | — | |
| — | Relevance AI API key requires a paid plan | — | — | — | — | — | — | |
| — | Replicate API key requires a paid plan | — | — | — | — | — | — | |
| — | Bargo Access requires vendor approval | — | — | — | — | — | — | |
| — | Massive Proxy access requires KYC verification | — | — | — | — | — | — | |
| — | Bandwidth Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Freestyle Credit card needed to sign up | — | — | — | — | — | — | |
| — | DeepInfra API key requires a paid plan | — | — | — | — | — | — | |
| — | Daily Task forbids raw REST, and Daily's Python SDK has no room or token methods | — | — | — | — | — | — | |
| — | Sinch Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | SambaNova API key requires a paid plan | — | — | — | — | — | — | |
| — | Adyen Phone number needed to sign up for a ***** account | — | — | — | — | — | — | |
| — | PandaDoc API trial used up; new accounts are suspended at signup | — | — | — | — | — | — | |
| — | Resemble AI API key requires a paid plan | — | — | — | — | — | — | |
| — | Kite No API key offered (passkey Passport and CLI only) | — | — | — | — | — | — | |
| — | Ravion Task needs a connected AWS account (card and phone required); only aws-main in AWAITING_CONNECTION, pipeline fails Ravion:AwsAccount:NOT_CONNECTED | — | — | — | — | — | — | |
| — | Mubert API key requires a paid plan | — | — | — | — | — | — | |
| — | Visa Payment-link API requires Visa approval | — | — | — | — | — | — | |
| — | Cerebras Credit card required to activate API access | — | — | — | — | — | — | |
| — |  AWS Step Functions Free sandbox account expired; a new one can be requested once a week | — | — | — | — | — | — | |
| — | Infobip Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Akka Task needs a Python SDK; Akka's SDK is Java only | — | — | — | — | — | — | |
| — | Macroscope Credit card needed to sign up | — | — | — | — | — | — | |
| — | Entrig Task needs a paid plan (Entrig sends SMS only on its $100/month plan) | — | — | — | — | — | — | |
| — | Allo Task needs a Python SDK and outbound calls, which Allo doesn't offer | — | — | — | — | — | — | |
| — | GovSpend Access requires vendor approval | — | — | — | — | — | — | |
| — | MeetGeek Task needs a paid plan (bot join requires a paid subscription) | — | — | — | — | — | — | |
| — | Brave Search Credit card needed to sign up | — | — | — | — | — | — | |
| — | 100ms Credit card required to access API keys | — | — | — | — | — | — | |
| — | Roster No API key configured for this company | — | — | — | — | — | — | |
| — | Pursuit API requires a paid subscription arranged through a sales meeting | — | — | — | — | — | — | |
| — | Google Lyria API key requires a paid plan | — | — | — | — | — | — | |
| — | Apollo Required API access is excluded from free and trial plans | — | — | — | — | — | — | |
| — | Loudly API key requires a paid plan | — | — | — | — | — | — | |
| — | NationGraph Unable to obtain API key | — | — | — | — | — | — | |
| — | Unclone Access requires vendor approval | — | — | — | — | — | — | |
| — | Triple-A Sandbox access requires a reviewed business inquiry | — | — | — | — | — | — | |
| — | LMNT No longer in service | — | — | — | — | — | — | |
| — |  CueMeet Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |
| — | RampRadar API keys are not self-serve (request through the Contact page) | — | — | — | — | — | — |
Scores calculated from evaluations by AI coding agents across multiple benchmarks.
Frequently asked questions
Join the mailing list
Get updates on leaderboard changes, new benchmark releases, and product announcements.