ClickTap any row to explore the full eval.
Get your API graded →
| Rank | Tool | Score | Grade | Cost | Calls | Errors | Time | Report |
|---|---|---|---|---|---|---|---|---|
🥇 | Postman | 93 | A | $0.0007 | 9 | 0 | 41s | |
🥇 | Stripe | 93 | A | $0.0008 | 8 | 0 | 38s | |
🥇 | Fireworks AI | 93 | A | $0.0006 | 8 | 0 | 36s | |
🥇 | AssemblyAI | 93 | A | $0.0018 | 8 | 0 | 59s | |
🥇 | Prefect | 93 | A | $0.0008 | 9 | 0 | 55s | |
6 | Vercel | 90 | A | $0.0009 | 10 | 0 | 1m 8s | |
7, Tied with 2 others | Deepgram | 89 | B | $0.0005 | 10 | 3 | 46s | |
7, Tied with 2 others | fastCRW | 89 | B | $0.0031 | 10 | 1 | 36s | |
7, Tied with 2 others | ElevenLabs | 89 | B | $0.0006 | 9 | 1 | 41s | |
10, Tied with 8 others | Pipecat | 88 | B | $0.0015 | 15 | 0 | 1m 22s | |
10, Tied with 8 others | Airwallex | 88 | B | $0.0006 | 9 | 0 | 39s | |
10, Tied with 8 others | Clerk | 88 | B | $0.0019 | 11 | 0 | 1m 0s | |
10, Tied with 8 others | Dropbox | 88 | B | $0.0004 | 8 | 0 | 40s | |
10, Tied with 8 others | Rime | 88 | B | $0.0006 | 8 | 0 | 48s | |
10, Tied with 8 others | Tavily | 88 | B | $0.0012 | 11 | 0 | 1m 6s | |
10, Tied with 8 others | LlamaParse | 88 | B | $0.0027 | 12 | 0 | 1m 5s | |
10, Tied with 8 others | Merge Gateway | 88 | B | $0.0016 | 11 | 0 | 1m 23s | |
10, Tied with 8 others | Steel | 88 | B | $0.0012 | 12 | 0 | 1m 20s | |
19, Tied with 5 others | Agentmail | 87 | B | $0.0008 | 14 | 1 | 58s | |
19, Tied with 5 others | Weaviate | 87 | B | $0.0016 | 11 | 1 | 52s | |
19, Tied with 5 others | OpenRouter | 87 | B | $0.0008 | 11 | 1 | 35s | |
19, Tied with 5 others | E2B | 87 | B | $0.0018 | 14 | 1 | 55s | |
19, Tied with 5 others | Box | 87 | B | $0.0027 | 19 | 0 | 1m 27s | |
19, Tied with 5 others | Stability AI | 87 | B | $0.0009 | 11 | 1 | 44s | |
25, Tied with 1 other | Mesh API | 86 | B | $0.0013 | 16 | 0 | 57s | |
25, Tied with 1 other | Descope | 86 | B | $0.0015 | 25 | 0 | 1m 0s | |
27, Tied with 7 others | Inkbox | 85 | B | $0.0096 | 21 | 0 | 1m 3s | |
27, Tied with 7 others | WorkOS | 85 | B | $0.0022 | 15 | 1 | 1m 21s | |
27, Tied with 7 others | Qdrant | 85 | B | $0.0011 | 13 | 3 | 1m 9s | |
27, Tied with 7 others | Pinecone | 85 | B | $0.0014 | 15 | 1 | 1m 6s | |
27, Tied with 7 others | OpenCageData | 85 | B | $0.0008 | 8 | 1 | 40s | |
27, Tied with 7 others | Elasticsearch | 85 | B | $0.0022 | 6 | 1 | 40s | |
27, Tied with 7 others | Daytona | 85 | B | $0.0013 | 15 | 1 | 1m 27s | |
27, Tied with 7 others | Neo4j | 85 | B | $0.0011 | 10 | 2 | 50s | |
35, Tied with 5 others | Scrapfly | 84 | B | $0.0006 | 7 | 0 | 46s | |
35, Tied with 5 others | TinyFish | 84 | B | $0.0014 | 10 | 0 | 1m 34s | |
35, Tied with 5 others | Netlify | 84 | B | $0.0033 | 25 | 0 | 2m 44s | |
35, Tied with 5 others | CockroachDB | 84 | B | $0.0082 | 6 | 0 | 31s | |
35, Tied with 5 others | Reducto | 84 | B | $0.0016 | 17 | 1 | 1m 6s | |
35, Tied with 5 others | Memgraph | 84 | B | $0.0006 | 8 | 0 | 37s | |
41, Tied with 8 others | AINative Studio | 83 | B | $0.0080 | 15 | 2 | 51s | |
41, Tied with 8 others | Render | 83 | B | $0.0026 | 28 | 0 | 4m 16s | |
41, Tied with 8 others | Merge | 83 | B | $0.0044 | 30 | 0 | 4m 10s | |
41, Tied with 8 others | Meetstream | 83 | B | $0.0013 | 17 | 0 | 1m 21s | |
41, Tied with 8 others | Bolna | 83 | B | $0.0015 | 11 | 1 | 58s | |
41, Tied with 8 others | Vonage | 83 | B | $0.0026 | 11 | 0 | 1m 7s | |
41, Tied with 8 others | Supabase | 83 | B | $0.0042 | 17 | 3 | 1m 16s | |
41, Tied with 8 others | FalkorDB | 83 | B | $0.0015 | 14 | 1 | 55s | |
41, Tied with 8 others | Zep | 83 | B | $0.0042 | 28 | 0 | 4m 48s | |
50, Tied with 6 others | Zernio | 82 | B | $0.0015 | 16 | 1 | 44s | |
50, Tied with 6 others | Zilliz Cloud | 82 | B | $0.0013 | 11 | 0 | 1m 39s | |
50, Tied with 6 others | Netflix Conductor | 82 | B | $0.0018 | 8 | 1 | 39s | |
50, Tied with 6 others | Convex | 82 | B | $0.0018 | 22 | 0 | 1m 23s | |
50, Tied with 6 others | Chroma | 82 | B | $0.0018 | 18 | 3 | 1m 50s | |
50, Tied with 6 others | Speechify | 82 | B | $0.0008 | 18 | 1 | 52s | |
50, Tied with 6 others | AIsa | 82 | B | $0.0012 | 22 | 0 | 1m 22s | |
57, Tied with 7 others | Olostep | 81 | B | $0.0138 | 19 | 0 | 1m 55s | |
57, Tied with 7 others | Firecrawl | 81 | B | $0.0025 | 25 | 3 | 1m 32s | |
57, Tied with 7 others | Paddle | 81 | B | $0.0027 | 27 | 3 | 1m 47s | |
57, Tied with 7 others | Resend | 81 | B | $0.0034 | 41 | 2 | 2m 5s | |
57, Tied with 7 others | Apify | 81 | B | $0.0248 | 32 | 6 | 2m 4s | |
57, Tied with 7 others | Superserve | 81 | B | $0.0022 | 27 | 5 | 2m 13s | |
57, Tied with 7 others | OpenAI Whisper | 81 | B | $0.0005 | 6 | 0 | 59s | |
57, Tied with 7 others | Browserbase | 81 | B | $0.0023 | 23 | 1 | 2m 7s | |
65, Tied with 14 others | Shopware | 80 | B | $0.0038 | 41 | 4 | 3m 28s | |
65, Tied with 14 others | Speechmatics | 80 | B | $0.0007 | 10 | 1 | 45s | |
65, Tied with 14 others | Tavus | 80 | B | $0.0011 | 18 | 1 | 6m 30s | |
65, Tied with 14 others | Groq | 80 | B | $0.0009 | 8 | 0 | 43s | |
65, Tied with 14 others | Scalekit | 80 | B | $0.0076 | 37 | 3 | 2m 31s | |
65, Tied with 14 others | Jina AI | 80 | B | $0.0050 | 27 | 1 | 4m 20s | |
65, Tied with 14 others | You.com | 80 | B | $0.0046 | 29 | 2 | 2m 35s | |
65, Tied with 14 others | Restate | 80 | B | $0.0061 | 52 | 1 | 3m 52s | |
65, Tied with 14 others | Exa | 80 | B | $0.0041 | 14 | 1 | 1m 29s | |
65, Tied with 14 others | ZenRows | 80 | B | $0.0054 | 13 | 1 | 1m 1s | |
65, Tied with 14 others | Nylas | 80 | B | $0.0032 | 26 | 0 | 2m 0s | |
65, Tied with 14 others | Browser Use | 80 | B | $0.0035 | 31 | 2 | 3m 19s | |
65, Tied with 14 others | Orkes | 80 | B | $0.0110 | 9 | 1 | 38s | |
65, Tied with 14 others | Mux | 80 | B | $0.0041 | 32 | 1 | 2m 38s | |
65, Tied with 14 others | Cloudflare | 80 | B | $0.0050 | 41 | 6 | 4m 0s | |
80, Tied with 14 others | Mollie | 79 | B | $0.0057 | 15 | 0 | 1m 21s | |
80, Tied with 14 others | VideoDB | 79 | B | $0.0041 | 32 | 2 | 7m 17s | |
80, Tied with 14 others | Fly.io | 79 | B | $0.0133 | 26 | 2 | 5m 52s | |
80, Tied with 14 others | Cartesia | 79 | B | $0.0025 | 16 | 3 | 1m 9s | |
80, Tied with 14 others | Auth0 | 79 | B | $0.0024 | 17 | 1 | 1m 8s | |
80, Tied with 14 others | Twilio | 79 | B | $0.0057 | 32 | 6 | 5m 2s | |
80, Tied with 14 others | Railway | 79 | B | $0.0087 | 38 | 4 | 17m 52s | |
80, Tied with 14 others | Vapi | 79 | B | $0.0107 | 33 | 1 | 14m 41s | |
80, Tied with 14 others | Blaxel | 79 | B | $0.0010 | 19 | 3 | 1m 20s | |
80, Tied with 14 others | Cognee | 79 | B | $0.0077 | 34 | 6 | 6m 19s | |
80, Tied with 14 others | Naive | 79 | B | $0.0023 | 16 | 1 | 1m 19s | |
80, Tied with 14 others | Extend.ai | 79 | B | $0.0017 | 16 | 3 | 1m 0s | |
80, Tied with 14 others | Camunda | 79 | B | $0.0053 | 64 | 4 | 7m 49s | |
80, Tied with 14 others | Mem0 | 79 | B | $0.0038 | 30 | 1 | 6m 20s | |
80, Tied with 14 others | Oodle | 79 | B | $0.0097 | 47 | 1 | 5m 40s | |
95, Tied with 4 others | Keenable | 78 | B | $0.0056 | 16 | 1 | 1m 42s | |
95, Tied with 4 others | Diffbot | 78 | B | $0.0013 | 13 | 1 | 50s | |
95, Tied with 4 others | HitPay | 78 | B | $0.0015 | 20 | 0 | 1m 13s | |
95, Tied with 4 others | Coinbase Payments | 78 | B | $0.0025 | 20 | 2 | 1m 43s | |
95, Tied with 4 others | Zoom AI Services | 78 | B | $0.0029 | 18 | 5 | 1m 40s | |
100, Tied with 3 others | Sprites (Fly.io) | 77 | B | $0.0034 | 25 | 3 | 2m 12s | |
100, Tied with 3 others | Twelve Labs | 77 | B | $0.0031 | 19 | 1 | 2m 31s | |
100, Tied with 3 others | CopilotKit | 77 | B | $0.0028 | 21 | 1 | 1m 31s | |
100, Tied with 3 others | Google DeepMind | 77 | B | $0.0013 | 13 | 1 | 5m 52s | |
104, Tied with 5 others | Diagrid | 76 | B | $0.0384 | 29 | 1 | 1m 38s | |
104, Tied with 5 others | Nebius AI Cloud | 76 | B | $0.0022 | 26 | 1 | 1m 53s | |
104, Tied with 5 others | Agora | 76 | B | $0.0082 | 25 | 1 | 2m 31s | |
104, Tied with 5 others | TABStack | 76 | B | $0.0027 | 22 | 2 | 2m 30s | |
104, Tied with 5 others | PayPal | 76 | B | $0.0044 | 23 | 1 | 2m 32s | |
104, Tied with 5 others | Anchor Browser | 76 | B | $0.0022 | 23 | 1 | 2m 44s | |
110, Tied with 6 others | AgentLine | 75 | B | $0.0072 | 18 | 2 | 1m 16s | |
110, Tied with 6 others | BlindPay | 75 | B | $0.0043 | 43 | 1 | 3m 43s | |
110, Tied with 6 others | Meeting BaaS | 75 | B | $0.0016 | 13 | 0 | 1m 11s | |
110, Tied with 6 others | Nimble | 75 | B | $0.0035 | 32 | 1 | 2m 32s | |
110, Tied with 6 others | Modal | 75 | B | $0.0017 | 17 | 6 | 1m 9s | |
110, Tied with 6 others | Letta | 75 | B | $0.0035 | 23 | 2 | 5m 25s | |
110, Tied with 6 others | Hookdeck | 75 | B | $0.0097 | 35 | 1 | 4m 16s | |
117, Tied with 5 others | LanceDB | 74 | C | $0.0013 | 15 | 1 | 1m 35s | |
117, Tied with 5 others | LiveKit | 74 | C | $0.0031 | 26 | 1 | 7m 28s | |
117, Tied with 5 others | BoldSign | 74 | C | $0.0034 | 24 | 1 | 1m 28s | |
117, Tied with 5 others | Docusign | 74 | C | $0.0033 | 15 | 1 | 1m 32s | |
117, Tied with 5 others | TigerGraph | 74 | C | $0.0128 | 58 | 4 | 11m 47s | |
117, Tied with 5 others | Tenki | 74 | C | $0.0013 | 21 | 3 | 1m 24s | |
123 | Okta | 73 | C | $0.0149 | 25 | 1 | 2m 8s | |
124, Tied with 1 other | Plivo | 72 | C | $0.0039 | 32 | 2 | 2m 3s | |
124, Tied with 1 other | Stytch | 72 | C | $0.0018 | 14 | 2 | 1m 0s | |
126, Tied with 1 other | Subotiz | 71 | C | $0.0303 | 52 | 2 | 4m 18s | |
126, Tied with 1 other | Surge | 71 | C | $0.0023 | 29 | 2 | 3m 6s | |
128, Tied with 2 others | Rev AI | 70 | C | $0.0007 | 14 | 1 | 2m 2s | |
128, Tied with 2 others | Prelude | 70 | C | $0.0012 | 12 | 1 | 52s | |
128, Tied with 2 others | BetterStack | 70 | C | $0.0056 | 33 | 0 | 3m 9s | |
131, Tied with 1 other | Recall.ai | 68 | C | $0.0016 | 18 | 0 | 1m 31s | |
131, Tied with 1 other | Square | 68 | C | $0.0028 | 27 | 1 | 1m 30s | |
133, Tied with 1 other | DFNS | 67 | C | $0.0064 | 36 | 1 | 2m 54s | |
133, Tied with 1 other | Cadence | 67 | C | $0.0071 | 47 | 4 | 2m 34s | |
135 | Vectoree | 66 | C | $0.0163 | 18 | 1 | 1m 20s | |
136, Tied with 2 others | LemonSqueezy | 62 | C | $0.0018 | 15 | 1 | 1m 31s | |
136, Tied with 2 others | Sensible | 62 | C | $0.0057 | 40 | 4 | 4m 42s | |
136, Tied with 2 others | Pioneer AI | 62 | C | $0.0055 | 35 | 1 | 3m 49s | |
139 | Workato | 61 | C | $0.1480 | 66 | 3 | 10m 2s | |
140 | Celigo | 60 | C | $0.2324 | 87 | 3 | 13m 47s | |
141 | Apideck | 50 | D | $0.0040 | 44 | 3 | 50m 42s | |
| — | Cloudflare Workers Task needs a paid plan (Cloudflare Sandbox SDK requires Workers Paid) | — | — | — | — | — | — | |
| — | Fireblocks Phone number needed to sign up (developer sandbox form) | — | — | — | — | — | — | |
| — | Telnyx Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Ash Hosted Ash Cloud gives no working runtime on a free account (0 credits; credits from $10) | — | — | — | — | — | — | |
| — | Sonilo API key requires a paid plan | — | — | — | — | — | — | |
| — | Unstructured Unable to obtain API key | — | — | — | — | — | — | |
| — | Datadog Unable to obtain API key | — | — | — | — | — | — | |
| — | Dust API key requires a paid plan | — | — | — | — | — | — | |
| — | ElevenLabs Music Music API requires a paid plan | — | — | — | — | — | — | |
| — | Kosuke Unable to obtain API key | — | — | — | — | — | — | |
| — | Azion CLI build and deploy outlast the harness's no-output timeout | — | — | — | — | — | — | |
| — | Nebius Token Factory Credit card needed to sign up | — | — | — | — | — | — | |
| — | Circle Faucet API requires a Mainnet account with billing details | — | — | — | — | — | — | |
| — | Temporal Credit card required to start the free trial | — | — | — | — | — | — | |
| — | Razorpay Phone number or PAN needed before *****-mode keys | — | — | — | — | — | — | |
| — | DigitalOcean Credit card needed to sign up | — | — | — | — | — | — | |
| — | TogetherAI API key requires a paid plan | — | — | — | — | — | — | |
| — | HeyGen API key requires a paid plan | — | — | — | — | — | — | |
| — | Strapi Hosted Strapi Cloud requires a paid plan (no free plan or trial) | — | — | — | — | — | — | |
| — | Upsun Access requires vendor approval | — | — | — | — | — | — | |
| — | Perplexity API key requires a paid plan | — | — | — | — | — | — | |
| — | Chargebee Credit card or phone needed to sign up (site API answers 403 api_disabled 'site is not enabled'; new account needs phone verification) | — | — | — | — | — | — | |
| — | CocoIndex Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |
| — | Gumloop Credit card needed to sign up | — | — | — | — | — | — | |
| — | Relevance AI API key requires a paid plan | — | — | — | — | — | — | |
| — | Replicate API key requires a paid plan | — | — | — | — | — | — | |
| — | Bargo Access requires vendor approval | — | — | — | — | — | — | |
| — | Massive Proxy access requires KYC verification | — | — | — | — | — | — | |
| — | Bandwidth Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Freestyle Credit card needed to sign up | — | — | — | — | — | — | |
| — | DeepInfra API key requires a paid plan | — | — | — | — | — | — | |
| — | Daily Task forbids raw REST, and Daily's Python SDK has no room or token methods | — | — | — | — | — | — | |
| — | Sinch Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | SambaNova API key requires a paid plan | — | — | — | — | — | — | |
| — | Adyen Phone number needed to sign up for a ***** account | — | — | — | — | — | — | |
| — | PandaDoc API trial used up; new accounts are suspended at signup | — | — | — | — | — | — | |
| — | Resemble AI API key requires a paid plan | — | — | — | — | — | — | |
| — | Kite No API key offered (passkey Passport and CLI only) | — | — | — | — | — | — | |
| — | Ravion Task needs a connected AWS account (card and phone required); only aws-main in AWAITING_CONNECTION, pipeline fails Ravion:AwsAccount:NOT_CONNECTED | — | — | — | — | — | — | |
| — | Mubert API key requires a paid plan | — | — | — | — | — | — | |
| — | Visa Payment-link API requires Visa approval | — | — | — | — | — | — | |
| — | Cerebras Credit card required to activate API access | — | — | — | — | — | — | |
| — | AWS Step Functions Free sandbox account expired; a new one can be requested once a week | — | — | — | — | — | — | |
| — | Infobip Phone number needed (SMS verification) | — | — | — | — | — | — | |
| — | Akka Task needs a Python SDK; Akka's SDK is Java only | — | — | — | — | — | — | |
| — | Macroscope Credit card needed to sign up | — | — | — | — | — | — | |
| — | Entrig Task needs a paid plan (Entrig sends SMS only on its $100/month plan) | — | — | — | — | — | — | |
| — | Allo Task needs a Python SDK and outbound calls, which Allo doesn't offer | — | — | — | — | — | — | |
| — | GovSpend Access requires vendor approval | — | — | — | — | — | — | |
| — | MeetGeek Task needs a paid plan (bot join requires a paid subscription) | — | — | — | — | — | — | |
| — | Brave Search Credit card needed to sign up | — | — | — | — | — | — | |
| — | 100ms Credit card required to access API keys | — | — | — | — | — | — | |
| — | Roster No API key configured for this company | — | — | — | — | — | — | |
| — | Pursuit API requires a paid subscription arranged through a sales meeting | — | — | — | — | — | — | |
| — | Google Lyria API key requires a paid plan | — | — | — | — | — | — | |
| — | Apollo Required API access is excluded from free and trial plans | — | — | — | — | — | — | |
| — | Loudly API key requires a paid plan | — | — | — | — | — | — | |
| — | NationGraph Unable to obtain API key | — | — | — | — | — | — | |
| — | Unclone Access requires vendor approval | — | — | — | — | — | — | |
| — | Triple-A Sandbox access requires a reviewed business inquiry | — | — | — | — | — | — | |
| — | LMNT No longer in service | — | — | — | — | — | — | |
| — | CueMeet Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | |
| — | RampRadar API keys are not self-serve (request through the Contact page) | — | — | — | — | — | — |
Scores calculated from evaluations by AI coding agents across multiple benchmarks.
Frequently asked questions
Join the mailing list
Get updates on leaderboard changes, new benchmark releases, and product announcements.