Twelve Labs
75/ 100
BScore Breakdown75%
Lost points on 4 checks
- time2/15
- efficiency0/10
- zero errors0/5
- CLI0/14
Eval Score (70% weight)71%
cost$0.00 (<$0.05, excellent)+10
time228s (150s–300s, very slow)+2
efficiency38 tool calls (>25, inefficient)+0
found docsTouched docs at docs.twelvelabs.io: yes (7 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 6+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(71 × 0.7) + (86 × 0.3)= 75%
Replay
Using https://docs.twelvelabs.io/, complete the following task: Using the Twelve Labs Python SDK, build me a script that demonstrates video infrastructure capabilities: 1. Install the official Twelve Labs Python SDK (pip install) 2. Upload or ingest a sample video (you can use this public video URL: https://sample-videos.com/video321/mp4/720/big_buck_bunny_720p_1mb.mp4) 3. Wait for processing/indexing to complete (poll status if the API is async) 4. Search or query the video content — for example, search for "bunny" or query a specific timestamp 5. Print the result as JSON with fields: video_id, status, and either search_results or video_metadata You MUST use the official Twelve Labs Python SDK — do not make raw HTTP/REST calls.
twelvelabs_demo.py
Unlock analytics
See Twelve Labs's score trend, layer rankings, and competitive position.
Run completed Oct 21, 2026, 10:16 PM