Back to leaderboard

LanceDB

Same Vector Databases task · View

#6 in Vector Databases

9D

MCP task scoring

Task score
0%
Task
Failed+0MCP setup command failed (exit 1): cd /home/daytona/lancedb-mcp-server && uv sync Resolved 80 packages in 1ms Downloadin...
Used MCP Correctly
Failed+0MCP setup command failed (exit 1): cd /home/daytona/lancedb-mcp-server && uv sync Resolved 80 packages in 1ms Downloadin...
Partial Credit
Failed+0Partial credit: 0%
Zero Errors
Failed+0Task execution never began because MCP tools were unavailable.
Efficiency
Failed+0No real MCP tool definitions were available to execute.
Time
Failed+0Task aborted before execution because MCP tools were unavailable.
Cost
Failed+0Task aborted before execution because MCP tools were unavailable.
Runtime (actual)Lower is better
4m 6s
Cost (actual)Lower is better
$0.3162
Tool callsLower is better
15
ErrorsLower is better
0
Tokens usedLower is better
400,244

MCP discovery

Discovery score
30%
Official MCP
Passed5/5
Auth Method
Failed0/15none
Tool Count
Failed0/100 tools, bloated
Tool Description Length
Passed10/100 tokens, lean
llms.txt
Passed10/10
Output Schema
Failed0/5
Tool Stability
Passed5/5
Security Posture
—
Tool API Mapping
—
Description Clarity
—

Eval details

Integration task
# Task Using the LanceDB MCP, perform vector database operations: 1. Discover available MCP tools and their capabilities 2. Create a new collection/index called "faq-*****" 3. Li...
Generated files
0
Trace tool calls
15
Completed
9/27/2026
Stderr
None captured
Full eval