Broken Link Checker MCP Server
An MCP (Model Context Protocol) server that scans web pages and domains to identify broken links.
Features
- Single Page Checking: Scan all links on a single page
- Domain-Wide Crawling: Recursively check all pages within a domain
- Comprehensive Link Detection: Checks hyperlinks, images, scripts, stylesheets, and media
- robots.txt Compliance: Respects website crawling rules
- Structured Output: Returns detailed results with link status and locations
Installation
pip install -e .
Usage
Start the MCP server with HTTP transport:
python src/server.py
The server will run on http://127.0.0.1:8000 by default.
MCP Tools
check_page
Check all links on a single page.
Parameters:
url(string): The URL of the page to check
check_domain
Recursively check all pages within a domain.
Parameters:
url(string): The root URL of the domain to checkmax_depth(integer, optional): Maximum crawl depth (-1 for unlimited, default: -1)
Output Format
Results are returned in the following structure:
{
"results": [
{
"page_url": "https://example.com/page",
"link_reference": "Click here",
"link_url": "https://broken.com/404",
"status": "Bad"
}
],
"summary": {
"total_links": 150,
"good_links": 145,
"bad_links": 5,
"pages_scanned": 10
}
}
Development
Install development dependencies:
pip install -e ".[dev]"
Run tests:
pytest