Firecrawl Local MCP Server
An MCP (Model Context Protocol) server for interacting with a self-hosted Firecrawl instance. This server provides web scraping and crawling capabilities through your local Firecrawl deployment.
Features
- Web Scraping: Extract content from single web pages in markdown format
- Web Crawling: Crawl entire websites with customizable depth and filtering
- Site Mapping: Generate lists of all accessible URLs on a website
- Job Monitoring: Track the status of crawling jobs
- No API Key Required: Works directly with self-hosted Firecrawl instances
Installation
npm install
npm run build
Configuration
The server connects to your Firecrawl instance using the FIRECRAWL_URL environment variable. By default, it connects to http://localhost:3002.
To change the Firecrawl URL, set the FIRECRAWL_URL environment variable in your MCP configuration.
Usage
With Claude Desktop
Add this to your Claude Desktop configuration file (claude_desktop_config.json):
{
"mcpServers": {
"firecrawl-local": {
"command": "node",
"args": ["/absolute/path/to/firecrawl-local-mcp/dist/index.js"],
"env": {
"FIRECRAWL_URL": "http://localhost:3002"
}
}
}
}
With Cline
Add this to your Cline MCP configuration file:
{
"mcpServers": {
"firecrawl-local": {
"command": "node",
"args": ["dist/index.js"],
"cwd": "/absolute/path/to/firecrawl-local-mcp",
"env": {
"FIRECRAWL_URL": "http://localhost:3002"
}
}
}
}
Available Tools
firecrawl_scrape
Scrape a single webpage and return its content in markdown format.
Parameters:
url(required): The URL to scrapeformats: Output formats (default: ["markdown"])onlyMainContent: Extract only main content (default: true)includeTags: HTML tags to includeexcludeTags: HTML tags to exclude
firecrawl_crawl
Crawl a website starting from a URL and return content from multiple pages.
Parameters:
url(required): The starting URL to crawlincludes: URL patterns to include (supports wildcards)excludes: URL patterns to exclude (supports wildcards)maxDepth: Maximum crawl depth (default: 2)limit: Maximum number of pages to crawl (default: 10)allowBackwardLinks: Allow crawling backward links (default: false)allowExternalLinks: Allow crawling external links (default: false)
firecrawl_crawl_status
Check the status of a crawl job.
Parameters:
jobId(required): The job ID returned from a crawl request
firecrawl_map
Map a website to get a list of all accessible URLs.
Parameters:
url(required): The URL to mapsearch: Search query to filter URLsignoreSitemap: Ignore the website's sitemap (default: false)includeSubdomains: Include subdomains (default: false)limit: Maximum number of URLs to return (default: 5000)
Testing
Test the server functionality:
node test.js
This will test both the tool listing and a sample scrape operation.
Example Usage
Once configured in Claude Desktop, you can use natural language commands like:
- "Scrape the content from https://example.com"
- "Crawl the documentation site at https://docs.example.com with a depth of 3"
- "Map all the URLs on https://example.com"
- "Check the status of crawl job abc123"
Requirements
- Node.js 18+
- A running Firecrawl self-hosted instance (see Firecrawl Self-Hosting Guide)
- Network access to the Firecrawl instance
Troubleshooting
- Connection Issues: Verify your Firecrawl instance is running and accessible
- Timeout Errors: Adjust timeout values in
src/index.tsfor slow websites - Authentication Errors: Ensure
USE_DB_AUTHENTICATION=falsein your Firecrawl .env file