FiftyOne MCP Server

Control FiftyOne datasets through AI assistants using the Model Context Protocol

Documentation · FiftyOne Skills · FiftyOne Plugins · Discord

What is the FiftyOne MCP Server?

Enable Agents to explore datasets, execute operators, and build computer vision workflows through natural language. This server exposes FiftyOne's operator framework (80+ built-in operators) through 16 MCP tools.

"List all my datasets"
"Load quickstart dataset and show summary"
"Find similar images in my dataset"

The server starts with 50 built-in operators. Install plugins to expand functionality - the AI can discover and install plugins automatically when needed (brain, zoo, annotation, evaluation, and more).

Available Tools

Category	Tools	Description
📊 Dataset Management	3	List, load, and summarize datasets
⚡ Operator System	5	Execute any FiftyOne operator dynamically
🔌 Plugin Management	5	Discover and install FiftyOne plugins
🖥️ Session Management	3	Control FiftyOne App for delegated execution

Design Philosophy: Minimal tool count (16 tools), maximum flexibility (full operator & plugin ecosystem).

Quick Start

Step 1: Install the MCP Server

pip install fiftyone-mcp-server

⚠️ Important: Make sure to use the same Python environment where you installed the MCP server when configuring your AI tool. If you installed it in a virtual environment or conda environment, you must activate that environment or specify the full path to the executable.

Step 2: Configure Your AI Tool

Claude Code (Recommended)

claude mcp add fiftyone -- fiftyone-mcp

Claude Desktop

Edit ~/Library/Application Support/Claude/claude_desktop_config.json:

{
  "mcpServers": {
    "fiftyone": {
      "command": "fiftyone-mcp"
    }
  }
}

Cursor

Add to ~/.cursor/mcp.json:

{
  "mcpServers": {
    "fiftyone": {
      "command": "fiftyone-mcp"
    }
  }
}

VSCode

Add to .vscode/mcp.json:

{
  "servers": {
    "fiftyone": {
      "command": "fiftyone-mcp"
    }
  }
}

ChatGPT Desktop

Edit ~/Library/Application Support/ChatGPT/config.json:

{
  "mcpServers": {
    "fiftyone": {
      "command": "fiftyone-mcp"
    }
  }
}

uvx (No Install Needed)

If you have uv installed:

{
  "mcpServers": {
    "fiftyone": {
      "command": "uvx",
      "args": ["fiftyone-mcp-server"]
    }
  }
}

This downloads and runs the latest version automatically.

Step 3: Use It

"List all my datasets"
"Load quickstart dataset and show summary"
"What operators are available for managing samples?"
"Set context to my dataset, then tag high-confidence samples"
"What plugins are available? Install the brain plugin"
"Find similar images in my dataset"

Claude will automatically discover operators and execute the appropriate tools.

Contributing

We welcome contributions! Here's how to set up a local development environment:

Clone the repository

git clone https://github.com/voxel51/fiftyone-mcp-server.git
cd fiftyone-mcp-server

Install dependencies
```
poetry install
```
Run the server locally
```
poetry run fiftyone-mcp
```

Test your changes

poetry run pytest
poetry run black -l 79 src/
npx @modelcontextprotocol/inspector poetry run fiftyone-mcp

Submit a Pull Request

Resources

Resource	Description
FiftyOne Docs	Official documentation
FiftyOne Skills	Expert workflows for AI assistants
FiftyOne Plugins	Official plugin collection
Model Context Protocol	MCP specification
PyPI Package	MCP server on PyPI
Discord Community	Get help and share ideas

Community

Join the FiftyOne community to get help, share your ideas, and connect with other users:

Discord: FiftyOne Community
GitHub Issues: Report bugs or request features