Freestyle

Freestyle

freestyle.shSandboxesGitHub CopilotGitHub Copilot
68/ 100
C
Score Breakdown68%

Lost points on 6 checks

  • cost3/10
  • time5/15
  • efficiency0/10
  • zero errors0/5
  • Context70/14
  • MCP Server0/14
Eval Score (70% weight)68%
cost$0.23 ($0.20–$0.40, good)+3
time173s (120s–180s, good)+5
efficiency34 tool calls (>25, inefficient)+0
found docsTouched docs at freestyle.sh: yes (24 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 4+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Checklist Score (30% weight)71%
Context7
+0
llms.txt
Link+14
MCP Server
+0
Typed SDK
Link+14
OpenAPI
Link+14
Agent Skills
Link+14
CLI
Link+14

Checklist determined by AI. If something looks wrong, .

Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(68 × 0.7) + (71 × 0.3)= 68%
Replay
Using https://www.freestyle.sh/docs, complete the following task:

Using Freestyle, build me a script that runs a multi-step computation inside a Freestyle sandbox:
        
1. Use the Freestyle Python SDK to create/connect to a sandbox
2. Inside the sandbox, execute the following pipeline:
   a. Install the `sympy` package using pip
   b. Run a Python script that:
      - Computes the 10th Fibonacci number iteratively
      - Uses sympy to check if that number is prime
      - Prints the result as JSON: {"fibonacci_10": <number>, "is_prime": <boolean>}
3. Capture the sandbox execution output and print it to stdout

All computation must run inside the Freestyle sandbox, not in your local Python process. Do not use subprocess — use the Freestyle SDK's execution primitives.
freestyle_pipeline.py

Unlock analytics

See Freestyle's score trend, layer rankings, and competitive position.

Run completed Oct 26, 2026, 6:29 PM