Back to leaderboard

Groq vs Fireworks AI

Same Inference task · View

#5 in Inference

77BBest on 6 of 14

#2 in Inference

83BBest on 3 of 14

Agent performance

Eval score
86%
76%
Task success
Passed
Passed
Cost per runLower is better
$0.1672
$0.2194
Tool callsLower is better
7
11
ErrorsLower is better
0
1
RuntimeLower is better
1m
1m 12s
Tokens usedLower is better
143,108
248,256

Discoverability

Discovery score
57%
100%
Context7
llms.txt
MCP Server
Typed SDK
OpenAPI
Not found
Agent Skills
Not found
CLI
Not found

Eval details

Integration task
# Task Using https://console.groq.com/docs, complete the following task: Using Groq, build me a script that extracts structured data from this invoice and returns JSON: --- INVO...
# Task Using https://docs.fireworks.ai, complete the following task: Using Fireworks AI, build me a script that extracts structured data from this invoice and returns JSON: ---...
Generated files
1
1
Trace tool calls
7
11
Completed
9/23/2026
9/23/2026
Stderr
None captured
None captured