Devtool Arena

Benchmarking how uses 150+ developer tools.

Latest results

Oct 2026 vs May 2026

Biggest improvements

Points gained since the May 2026 run

  1. +57
    Cloudflare
  2. +48
    Naive
  3. +45
    Netlify
  4. +40
    Zilliz Cloud
  5. +27
    Razorpay
  6. +24
    Qdrant
  7. +22
    Pinecone
  8. +21
    LiveKit
  9. +17
    Firecrawl
  10. +17
    Resend

Current top 10 companies

Oct 2026

  1. 93
    Qdrant
  2. 91
    Exa
  3. 89
    ElevenLabs
  4. 88
    Extend.ai
  5. 87
    LlamaParse
  6. 86
    LaunchDarkly
  7. 86
    Netlify
  8. 85
    Microsoft MarkItDown
  9. 85
    Razorpay
  10. 85
    Jina AI

Previous top 10 companies

May 2026

  1. 86
    You.com
  2. 81
    Exa
  3. 78
    Render
  4. 78
    Scrapfly
  5. 78
    Extend.ai
  6. 76
    Reducto
  7. 74
    Tavily
  8. 73
    Box
  9. 73
    ElevenLabs
  10. 72
    Stripe
Last updated Nov 16
Powered byLightsageLightsage

Tap any row to explore the full eval.
Get your API graded →

Search a tool (e.g. Stripe, Chroma)
RankTool
Score
Grade
Task
Eval
Discovery
Cost
Calls
Errors
Time
1🥇
Qdrant
Qdrant
93A9689$0.08906054s
View report
2🥈
Exa
Exa
91A8995$0.2404501m 22s
View report
3🥉
ElevenLabs
ElevenLabs
89B9380$0.0625402m 18s
View report
4
Extend.ai
Extend.ai
88B8889$0.1824404m 31s
View report
5
LlamaParse
LlamaParse
87B8982$0.1594302m 2s
View report
6
LaunchDarkly
LaunchDarkly
86B8884$0.17841001m 21s
View report
6
Netlify
Netlify
86B9369$0.0930402m 37s
View report
8
Microsoft MarkItDown
Microsoft MarkItDown
85B9270$0.1645301m 29s
View report
8
Razorpay
Razorpay
85B8878$0.0741603m 1s
View report
8
Jina AI
Jina AI
85B8489$0.1627703m 10s
View report
11
Pinecone
Pinecone
84B8486$0.1725803m 18s
View report
12
Stripe
Stripe
83B8386$0.15771302m 3s
View report
12
Box
Box
83B8482$0.1333904m 11s
View report
14
TokenLab
TokenLab
81B8770$0.1646405m 52s
View report
15
Agentmail
Agentmail
80B8375$0.1215605m 0s
View report
15
Cartesia
Cartesia
80B8472$0.1210804m 19s
View report
17
Azion
Azion
79B8467$0.1143602m 39s
View report
17
Firecrawl
Firecrawl
79B8955$0.1587502m 10s
View report
17
Resend
Resend
79B8470$0.1147703m 34s
View report
17
You.com
You.com
79B8955$0.1858502m 43s
View report
17
fastCRW
fastCRW
79B8955$0.1112202m 13s
View report
17
Statsig
Statsig
79B8468$0.1332803m 18s
View report
23
ConfigCat
ConfigCat
77B8070$0.23871202m 34s
View report
24
Render
Render
76B8945$0.1039502m 36s
View report
24
Scrapfly
Scrapfly
76B8945$0.1127202m 42s
View report
26
Reducto
Reducto
75B8455$0.1490603m 56s
View report
27
BlindPay
BlindPay
74C8158$0.2114903m 27s
View report
27
Cloudflare
Cloudflare
74C7474$0.1198913m 36s
View report
29
Zilliz Cloud
Zilliz Cloud
73C7082$0.13871226m 2s
View report
30
Descope
Descope
71C8345$0.12941102m 32s
View report
31
Flagsmith
Flagsmith
68C7650$0.21042403m 44s
View report
32
Daytona
Daytona
67C5888$0.0731502m 10s
View report
33
Twilio
Twilio
66C7545$0.18491042m 31s
View report
34
Naive
Naive
63C6658$0.242914210m 28s
View report
35
MeetGeek
MeetGeek
57C5855$0.0600402m 16s
View report
35
E2B
E2B
57C4490$0.1002521m 49s
View report
37
LiveKit
LiveKit
55C4970$0.0920603m 6s
View report
38
Nimble
Nimble
51D5445$0.1891503m 8s
View report
39
Nylas
Nylas
49D4655$0.1268604m 9s
View report
40
Adobe Acrobat
Adobe Acrobat
48D4458$0.41101101m 56s
View report
40
Prefect
Prefect
48D3189$0.22422273m 8s
View report
42
Massive
Massive
47D3282$0.12551554m 18s
View report
43
Tavily
Tavily
45D4255$0.1442822m 0s
View report
44
Clerk
Clerk
44D4055$0.15151562m 33s
View report
44
Scalekit
Scalekit
44D4348$0.0669534m 11s
View report
44
TABStack
TABStack
44D3470$0.12931053m 15s
View report
47
Chroma
Chroma
43D2489$0.40973676m 56s
View report
48
Paddle
Paddle
41D3555$0.1578934m 45s
View report
49
Groq
Groq
40D2477$0.31292955m 33s
View report
50
Apollo
Apollo
39D3648$0.64501709m 6s
View report
52
Deepgram
Deepgram
38D3155$0.12151554m 1s
View report
52
Telnyx
Telnyx
38D3545$0.19741343m 3s
View report
54
Convex
Convex
37D2763$0.21862535m 26s
View report
54
Resemble AI
Resemble AI
37D4030$0.1087821m 44s
View report
54
Datadog
Datadog
37D3055$0.12451645m 0s
View report
57
Meeting BaaS
Meeting BaaS
35D2755$0.306539104m 29s
View report
58
Plivo
Plivo
33D2845$0.20522153m 25s
View report
68
LanceDB
LanceDB
9D030$0.18412001m 36s
View report
50
Cerebras
Cerebras

Payment required

—————————Trace unavailable
59
PayPal
PayPal

Unable to run MCP evaluation

—————————Trace unavailable
60
Weaviate
Weaviate

Missing MCP auth env vars: WEAVIATE_URL, WEAVIATE_API_KEY

—————————Trace unavailable
60
Square
Square

Missing MCP auth env vars: SQUARE_APPLICATION_ID, SQUARE_ACCESS_TOKEN

—————————Trace unavailable
62
Merge Agent Handler
Merge Agent Handler

Unable to run MCP evaluation

—————————Trace unavailable
62
Composio
Composio

Unable to run MCP evaluation

—————————Trace unavailable
62
Arcade
Arcade

Unable to run MCP evaluation

—————————Trace unavailable
65
Auth0
Auth0

Unable to run MCP evaluation

—————————Trace unavailable
65
Fireblocks
Fireblocks

Unable to run MCP evaluation

—————————Trace unavailable
65
Coinbase Payments
Coinbase Payments

Unable to run MCP evaluation

—————————Trace unavailable
68
Recall.ai
Recall.ai

Unable to run MCP evaluation

—————————Trace unavailable
70
Pipecat
Pipecat

Open-source / self-hosted — no hosted API key available

—————————Trace unavailable
—
DigitalOcean
DigitalOcean

Signup requires a credit card

—————————Trace unavailable
—
Perplexity
Perplexity

API key requires a paid plan

—————————Trace unavailable
—
Adyen
Adyen

API key requires official certification

—————————Trace unavailable
—
Anchor Browser
Anchor Browser

No MCP server package available

—————————Trace unavailable
—
Sinch
Sinch

Missing MCP auth env vars: SINCH_APPLICATION_KEY, SINCH_APPLICATION_SECRET

—————————Trace unavailable
—
Vonage
Vonage

Missing MCP auth env vars: VONAGE_APPLICATION_ID, VONAGE_PRIVATE_KEY

—————————Trace unavailable
—
Airwallex
Airwallex

API key requires official certification

—————————Trace unavailable
—
Brave Search
Brave Search

API key requires a paid plan

—————————Trace unavailable
—
Netflix Conductor
Netflix Conductor

Open-source / self-hosted — no hosted API key available

—————————Trace unavailable
—
Bandwidth
Bandwidth

No MCP server package available

—————————Trace unavailable
—
OpenCageData
OpenCageData

No MCP server package available

—————————Trace unavailable
—
Cloudflare Workers
Cloudflare Workers

MCP server requires browser-based OAuth (cannot automate)

—————————Trace unavailable
—
Stytch
Stytch

MCP server requires browser-based OAuth (cannot automate)

—————————Trace unavailable
—
Vercel
Vercel

MCP server requires browser-based OAuth (cannot automate)

—————————Trace unavailable
—
TogetherAI
TogetherAI

API key requires a paid plan

—————————Trace unavailable
—
Railway
Railway

MCP server requires browser-based OAuth (cannot automate)

—————————Trace unavailable
—
Infobip
Infobip

No MCP server package available

—————————Trace unavailable
—
Fireworks AI
Fireworks AI

No MCP server package available

—————————Trace unavailable

Scores calculated from end-to-end MCP evaluations by AI coding agents.

Frequently asked questions

Join the mailing list

Get updates on leaderboard changes, new benchmark releases, and product announcements.