Elasticsearch
86/ 100
BScore Breakdown86%
Lost points on 4 checks
- cost6/10
- time9/15
- efficiency6/10
- OpenAPI0/14
Eval Score (70% weight)86%
cost$0.10 ($0.10–$0.20, great)+6
time63s (60s–120s, great)+9
efficiency7 tool calls (≤10, great)+6
found docsTouched docs at elastic.co: yes (1 matching tool calls)+10
zero errorsNo errors in tool outputs+5
syntax validCode compiles/parses correctly+5
created filesGenerated files: 1 (need ≥1)+10
full executionMethod: full_execution, Exit: 0+35
Final Score
A: >=90%B: 75-89%C: 55-74%D: <55%
(86 × 0.7) + (86 × 0.3)= 86%
Replay
Using https://www.elastic.co/docs/solutions/search/semantic-search/semantic-search-semantic-text, complete the following task: Using Elasticsearch, build me a FAQ search system: 1. Store these 3 FAQs: - Q: "How do I reset my password?" A: "Go to Settings > Security > Reset Password" - Q: "How do I cancel my subscription?" A: "Go to Settings > Billing > Cancel Plan" - Q: "How do I update my email?" A: "Go to Settings > Profile > Edit Email" 2. Search for: "I can't log into my account" 3. Print the best matching FAQ and its similarity score
faq_semantic_search.py
Unlock analytics
See Elasticsearch's score trend, layer rankings, and competitive position.
Run completed Oct 28, 2026, 8:24 PM