Merge Gateway vs Fireworks AI
Both ran the same Inference task · Same Inference task · View the taskView the task
CompanyClick a name to swap it
#6 in Inference · #53 overall
76BBest on 0 of 14
#2 in Inference · #25 overall
83BBest on 6 of 14
Compare up to 4. Next in Inference:
Agent performance
Eval score
66%
76%
Task success
Passed
Passed
Cost per runLower is better
$0.3961
$0.2194
Tool callsLower is better
27
11
ErrorsLower is better
4
1
RuntimeLower is better
3m 4s
1m 12s
Tokens usedLower is better
886,631
248,256
Discoverability
Discovery score
100%
100%
Eval details
Integration task
# Task
Using https://docs.merge.dev/merge-gateway, complete the following task:
Using Merge Gateway, build me a script that extracts structured data from this invoice and returns...
# Task
Using https://docs.fireworks.ai, complete the following task:
Using Fireworks AI, build me a script that extracts structured data from this invoice and returns JSON:
---...
Generated files
1
1
Trace tool calls
27
11
Completed
9/23/2026
9/23/2026
Stderr
None captured
None captured
#6 in Inference
76BBest on 0 of 14
#2 in Inference
83BBest on 6 of 14
Agent performance
Eval score
66%
76%
Task success
Passed
Passed
Cost per runLower is better
$0.3961
$0.2194
Tool callsLower is better
27
11
ErrorsLower is better
4
1
RuntimeLower is better
3m 4s
1m 12s
Tokens usedLower is better
886,631
248,256
Discoverability
Discovery score
100%
100%
Eval details
Integration task
# Task
Using https://docs.merge.dev/merge-gateway, complete the following task:
Using Merge Gateway, build me a script that extracts structured data from this invoice and returns...
# Task
Using https://docs.fireworks.ai, complete the following task:
Using Fireworks AI, build me a script that extracts structured data from this invoice and returns JSON:
---...
Generated files
1
1
Trace tool calls
27
11
Completed
9/23/2026
9/23/2026
Stderr
None captured
None captured
Full eval