Back to leaderboard

Merge Gateway vs Fireworks AI

Same Inference task · View

#6 in Inference

76BBest on 0 of 14

#2 in Inference

83BBest on 6 of 14

Agent performance

Eval score
66%
76%
Task success
Passed
Passed
Cost per runLower is better
$0.3961
$0.2194
Tool callsLower is better
27
11
ErrorsLower is better
4
1
RuntimeLower is better
3m 4s
1m 12s
Tokens usedLower is better
886,631
248,256

Discoverability

Discovery score
100%
100%
Context7
llms.txt
MCP Server
Typed SDK
OpenAPI
Agent Skills

Eval details

Integration task
# Task Using https://docs.merge.dev/merge-gateway, complete the following task: Using Merge Gateway, build me a script that extracts structured data from this invoice and returns...
# Task Using https://docs.fireworks.ai, complete the following task: Using Fireworks AI, build me a script that extracts structured data from this invoice and returns JSON: ---...
Generated files
1
1
Trace tool calls
27
11
Completed
9/23/2026
9/23/2026
Stderr
None captured
None captured