Get notified
Fireworks AI

Fireworks AI

fireworks.aiInferenceGitHub CopilotGitHub Copilot
83/ 100
B
Score Breakdown83%

Lost points on 4 checks

  • cost6/10
  • time9/15
  • efficiency2/10
  • zero errors0/5
Eval Score (70% weight)77%
cost$0.11 ($0.10–$0.20, great)+6
time66s (60s–120s, great)+9
efficiency18 tool calls (≤20, acceptable)+2
found docsTouched docs at docs.fireworks.ai: yes (10 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 1+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Checklist Score (30% weight)100%
Context7
Link+14
llms.txt
Link+14
MCP Server
Link+14
Typed SDK
Link+14
OpenAPI
Link+14
Agent Skills
Link+14
CLI
Link+14

Checklist determined by AI. If something looks wrong, .

Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(77 × 0.7) + (100 × 0.3)= 83%
Replay
Using https://docs.fireworks.ai, complete the following task:

Using Fireworks AI, build me a script that extracts structured data from this invoice and returns JSON:

---
INVOICE #INV-2024-0042
From: Acme Corp
Date: 2024-03-15

Items:
- Consulting Services: $500.00
- Travel Expenses: $150.00

Total: $650.00
---

The JSON output should have these fields: invoice_number, vendor, date, line_items (array), total
extract_invoice.py

Unlock analytics

See Fireworks AI's score trend, layer rankings, and competitive position.

Run completed Oct 26, 2026, 6:22 PM