LanceDB
74/ 100
CScore Breakdown74%
Lost points on 5 checks
- time3/15
- efficiency3/10
- zero errors0/5
- OpenAPI0/14
- CLI0/14
Eval Score (70% weight)76%
cost$0.00 (<$0.05, excellent)+10
time96s (90s–150s, slow)+3
efficiency15 tool calls (≤15, good)+3
found docsTouched docs at lancedb.github.io: yes (3 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 1+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(76 × 0.7) + (71 × 0.3)= 74%
Replay
Using https://lancedb.github.io/lancedb, complete the following task: Using LanceDB, build me a FAQ search system: 1. Store these 3 FAQs: - Q: "How do I reset my password?" A: "Go to Settings > Security > Reset Password" - Q: "How do I cancel my subscription?" A: "Go to Settings > Billing > Cancel Plan" - Q: "How do I update my email?" A: "Go to Settings > Profile > Edit Email" 2. Search for: "I can't log into my account" 3. Print the best matching FAQ and its similarity score
faq_search.py
Unlock analytics
See LanceDB's score trend, layer rankings, and competitive position.
Run completed Oct 20, 2026, 8:31 PM