Get notified
Weaviate

Weaviate

weaviate.ioVector DatabasesGitHub CopilotGitHub Copilot
79/ 100
B
Score Breakdown79%

Lost points on 4 checks

  • cost6/10
  • time5/15
  • efficiency0/10
  • zero errors0/5
Eval Score (70% weight)71%
cost$0.16 ($0.10–$0.20, great)+6
time138s (120s–180s, good)+5
efficiency33 tool calls (>25, inefficient)+0
found docsTouched docs at weaviate.io: yes (19 matching tool calls)+10
zero errorsTool outputs with errors/tracebacks: 1+0
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Checklist Score (30% weight)100%
Context7
Link+14
llms.txt
Link+14
MCP Server
Link+14
Typed SDK
Link+14
OpenAPI
Link+14
Agent Skills
Link+14
CLI
Link+14

Checklist determined by AI. If something looks wrong, .

Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(71 × 0.7) + (100 × 0.3)= 79%
Replay
Using https://weaviate.io/developers/weaviate, complete the following task:

Using Weaviate, build me a FAQ search system:

1. Store these 3 FAQs:
   - Q: "How do I reset my password?" A: "Go to Settings > Security > Reset Password"
   - Q: "How do I cancel my subscription?" A: "Go to Settings > Billing > Cancel Plan"
   - Q: "How do I update my email?" A: "Go to Settings > Profile > Edit Email"

2. Search for: "I can't log into my account"

3. Print the best matching FAQ and its similarity score
faq_search.py

Unlock analytics

See Weaviate's score trend, layer rankings, and competitive position.

Run completed Oct 26, 2026, 6:48 PM