🌐 Anysite MCP Server
Agent-First Web Scraping Infrastructure via Model Context Protocol
Connect your AI agents to real-time data from LinkedIn, Instagram, Reddit, Twitter, and any website through a single MCP server.
💎 MCP Unlimited Plan
Unlimited access to all 65+ Anysite MCP tools for just $30/month - perfect for AI agents and automation.
Get unlimited requests through Remote MCP Server with no request limits. Ideal for Claude Desktop, Cursor, n8n, and any MCP-compatible client.
📖 Learn more about MCP Unlimited →
Available integrations:
- Make.com Integration - Connect with Make.com workflows
- Clay Integration - Use with Clay enrichment platform
🎯 What is Anysite MCP Server?
Anysite MCP Server is a Model Context Protocol (MCP) implementation that gives AI agents direct access to web data through platform-specific APIs. Unlike traditional web scrapers, Anysite provides:
- 🔒 OAuth Authentication - Secure, one-click connection for Claude Desktop and other MCP clients
- 🌐 Multi-Platform Support - LinkedIn, Instagram, Reddit, Twitter, and custom web parsing
- 🤖 Agent-First Design - Built specifically for AI agents with structured data formats
- 🔄 Self-Healing APIs - Auto-recovery from platform changes and rate limits
- ⚡ Real-Time Data - Fresh data extraction without stale caches
Perfect for: AI research, lead generation, market intelligence, content monitoring, competitive analysis
⚡ Key Features
🎪 Supported Platforms
| Platform | Search | Profiles | Posts | Comments | DMs | Analytics |
|---|---|---|---|---|---|---|
| ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | |
| ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | |
| ✅ | ✅ | ✅ | ✅ | ❌ | ⚠️ | |
| Twitter/X | ✅ | ✅ | ✅ | ⚠️ | ❌ | ⚠️ |
| Any Website | ✅ | - | - | - | - | - |
🛠️ Core Capabilities
- Advanced Search & Filtering - Find people by title, company, location, education, skills
- Bulk Data Extraction - Extract thousands of profiles, posts, or comments in one request
- Network Analysis - Map connections, followers, engagement patterns
- Content Monitoring - Track posts, comments, reactions in real-time
- Account Management - Send messages, connection requests, post comments (LinkedIn)
- Smart Web Parsing - Extract structured data from any website using CSS selectors
🔐 Enterprise-Grade Features
- Rate Limit Management - Automatic backoff and retry with exponential delays
- Proxy Rotation - Built-in proxy support for high-volume requests
- Error Recovery - Self-healing mechanisms for platform changes
- Usage Analytics - Track API consumption and costs
- Team Management - Multi-user accounts with role-based access
🚀 Quick Start
Option 1: Remote MCP with OAuth (Recommended)
Perfect for Claude Desktop, Cline, Cursor, Windsurf, and other MCP clients that support OAuth.
Step 1: Get Your OAuth URL
- Sign up at app.anysite.io (100 free credits included)
- Navigate to MCP Server Integration
- Copy your OAuth URL:
https://mcp.anysite.io/
Step 2: Add to Your MCP Client
Claude Desktop (Click to expand)
- Open Claude Desktop → Settings → Connectors
- Click Add Custom Connector
- Fill in:
- Name: Anysite MCP
- OAuth URL:
https://mcp.anysite.io/
- Click Add → Connect → Allow Access
Cline / Cursor / Windsurf
Add to your MCP configuration file:
{
"mcpServers": {
"anysite": {
"command": "npx",
"args": ["-y", "@anysite/mcp"],
"env": {
"ANYSITE_OAUTH_URL": "https://mcp.anysite.io/mcp"
}
}
}
}
Configuration file locations:
- Cline:
.cline/mcp_settings.json - Cursor:
.cursor/mcp_config.json - Windsurf:
.windsurf/mcp_config.json
Step 3: Verify Connection
Ask your AI agent:
What MCP tools do you have access to?
Expected response should include:
search_linkedin_usersget_linkedin_profileget_instagram_usersearch_reddit_postsduckduckgo_searchsearch_youtube_videosparse_webpage- ... and 65+ more tools
Option 2: Local MCP Server (For Development)
Perfect for testing, development, custom integrations.
Installation
# Clone the repository
git clone https://github.com/anysiteio/anysite-mcp-server.git
cd anysite-mcp-server
# Install dependencies
npm install
# Build the project
npm run build
Configuration
Create .env file:
ANYSITE_ACCESS_TOKEN=your_access_token
ANYSITE_ACCOUNT_ID=your_account_id
Get your credentials from app.anysite.io
Run Server
npm start
Connect to MCP Client
Add to your MCP configuration:
{
"mcpServers": {
"anysite-local": {
"command": "node",
"args": ["/path/to/anysite-mcp-server/build/index.js"],
"env": {
"ANYSITE_ACCESS_TOKEN": "your_token",
"ANYSITE_ACCOUNT_ID": "your_account_id"
}
}
}
}
🎮 Usage Examples
LinkedIn: Find Decision Makers
Find me 10 CTOs at AI companies in San Francisco
The MCP server will:
- Search LinkedIn users with title="CTO", company_keywords="AI", location="San Francisco"
- Return structured profiles with name, headline, company, location
- Provide direct LinkedIn URLs for each profile
Instagram: Monitor Brand Mentions
Get the latest 20 Instagram posts mentioning @yourbrand
Reddit: Analyze Discussions
Search Reddit for posts about "LLM agents" in the last week,
sorted by top engagement
Multi-Platform Research
1. Find the LinkedIn profile of John Doe at Company X
2. Get his recent posts and engagement metrics
3. Find his Twitter profile and latest tweets
4. Cross-reference with Instagram presence
📖 Documentation
📚 Full Documentation
🔧 Tool Categories (65+ Total)
Web Search (1 tool)
duckduckgo_search- Web search powered by DuckDuckGo (up to 20 results)
Y Combinator (3 tools)
get_yc_company- Get comprehensive YC company information by slugsearch_yc_companies- Search YC companies with filters (batch, status, industry)search_yc_founders- Search YC founders by name, company, batch, industry
YouTube (3 tools)
search_youtube_videos- Search YouTube videos by queryget_youtube_video- Get detailed video information by ID or URLget_youtube_video_subtitles- Extract video subtitles with timestamps
SEC (2 tools)
search_sec_companies- Search SEC EDGAR filings with advanced filtersget_sec_document- Retrieve full SEC document content by URL
LinkedIn Tools (35 tools)
Search & Discovery (11 tools)
search_linkedin_users- Advanced user search with 10+ filterslinkedin_sales_navigator_search_users- Sales Navigator advanced searchsearch_linkedin_companies- Search companies with advanced filterssearch_linkedin_educations- Search educational institutions for filteringsearch_linkedin_industries- Search industries for filteringsearch_linkedin_locations- Search locations for filteringsearch_linkedin_jobs- Search job postings with filtersfind_linkedin_user_email- Find users by email addressget_linkedin_user_email_db- Get email from internal database (up to 10 profiles)get_linkedin_google_company- Find companies via Google searchget_linkedin_company- Company details lookup
User Profiles & Details (12 tools)
get_linkedin_profile- Full profile with experience, education, skillsget_linkedin_user_posts- User's post historyget_linkedin_user_comments- User's comment historyget_linkedin_user_reactions- Posts user reacted toget_linkedin_user_endorsers- Skill endorsersget_linkedin_user_certificates- Professional certificatesget_linkedin_user_education- Education historyget_linkedin_user_experience- Work experience detailsget_linkedin_user_skills- Skills and endorsementsget_linkedin_user_honors- Awards and honorsget_linkedin_user_patents- Patent informationget_linkedin_user_languages- Language proficiencies
Company Information (4 tools)
get_linkedin_company_employee_stats- Employee statisticsget_linkedin_company_employees- Employee list with filtersget_linkedin_company_posts- Company updatesget_linkedin_management_company_mentions- Track company mentions (requires ACCOUNT_ID)
Content & Posts (4 tools)
search_linkedin_posts- Search posts by keywords, author, dateget_linkedin_post_comments- Comment threadsget_linkedin_post_reactions- Who reacted and howget_linkedin_post_reposts- Reshare analysis
Management & Actions (3 tools) - Require ACCOUNT_ID
get_linkedin_management_me- Your account profilesend_linkedin_chat_message- Send direct messagesget_linkedin_chat_messages- Get conversation historyget_linkedin_chat_attachment_base64- Download chat attachmentssend_linkedin_connection_request- Connect with userssend_linkedin_post_comment- Comment on postssend_linkedin_post- Create new postsget_linkedin_conversations- Get all conversationsget_linkedin_user_connections- Get connections list
Groups (1 tool)
get_linkedin_group- Get group information and members
Instagram Tools (8 tools)
get_instagram_user- Profile info, followers, posts countget_instagram_user_posts- Post history with mediaget_instagram_user_reels- Reels/videosget_instagram_user_friendships- Followers/following listsget_instagram_post- Post details with metricsget_instagram_post_comments- Comment threadsget_instagram_post_likes- Who liked the postsearch_instagram_posts- Hashtag and keyword search
Twitter/X Tools (4 tools)
get_twitter_user- Profile detailssearch_twitter_users- Find usersget_twitter_user_posts- Tweet historysearch_twitter_posts- Advanced tweet search with 15+ filters
Reddit Tools (5 tools)
search_reddit_posts- Search with sort, time, subreddit filtersget_reddit_posts- Post details with score, commentsget_reddit_post_comments- Comment trees with nested repliesget_reddit_user_posts- Get posts from a specific Reddit userget_reddit_user_comments- Get comments from a specific Reddit user
Web Parsing Tools (2 tools)
parse_webpage- Extract content with 14+ CSS selector optionsget_sitemap- Parse website sitemaps
🤝 Integrations
Anysite MCP Server works with any MCP-compatible client:
AI Assistants
- ✅ Claude Desktop - Native OAuth support
- ✅ Cline - MCP configuration
- ✅ Cursor - Custom MCP server
- ✅ Windsurf - MCP integration
- ✅ Any MCP Client - Standard protocol
Development Tools
- 🔧 n8n - Anysite n8n nodes
- 🔧 LangChain - Custom tool integration
- 🔧 AutoGen - Agent tool registration
- 🔧 REST API - Direct API access
Comparison: Remote vs Local
| Feature | Remote MCP (OAuth) | Local MCP |
|---|---|---|
| Setup Time | < 2 minutes | ~10 minutes |
| Authentication | OAuth (secure, one-click) | API keys in config |
| Updates | Automatic | Manual git pull |
| Best For | Production, end-users | Development, testing |
| Credentials | Managed by Anysite | Self-managed |
| Revocation | One-click in dashboard | Manual removal |
| MCP Clients | Claude Desktop, Cline, etc. | Any MCP client |
Recommendation: Use Remote MCP for production and Local MCP for development/testing.
🏗️ Architecture
┌─────────────────┐
│ MCP Client │ (Claude Desktop, Cline, etc.)
│ (AI Agent) │
└────────┬────────┘
│ MCP Protocol
│
┌────────▼────────┐
│ Anysite MCP │
│ Server │
└────────┬────────┘
│ REST API
│
┌────────▼────────┐
│ Anysite API │ ← OAuth Authentication
│ Platform │ ← Rate Limiting
└────────┬────────┘ ← Proxy Rotation
│
┌────┴────┬────────┬─────────┬──────────┐
▼ ▼ ▼ ▼ ▼
LinkedIn Instagram Reddit Twitter Any Website
Key Components:
- MCP Protocol Layer - Standardized tool interface for AI agents
- API Abstraction - Platform-specific API adapters with error handling
- Authentication - OAuth 2.0 for secure credential management
- Self-Healing - Auto-retry and fallback mechanisms
- Rate Limiting - Smart backoff to prevent API bans
💡 Use Cases
🎯 Lead Generation & Sales
- Find decision makers by title, company, location
- Enrich CRM data with LinkedIn profiles
- Monitor competitor hiring and expansion
📊 Market Intelligence
- Track brand mentions across platforms
- Analyze competitor social media strategy
- Monitor industry trends and discussions
🔍 Research & Analytics
- Collect datasets for AI training
- Social network analysis
- Content performance tracking
🤖 AI Agent Workflows
- Multi-platform data correlation
- Automated outreach campaigns
- Cross-platform identity resolution
🛠️ Development
Building from Source
# Clone repository
git clone https://github.com/anysiteio/anysite-mcp-server.git
cd anysite-mcp-server
# Install dependencies
npm install
# Build TypeScript
npm run build
# Run in development mode
npm run dev
# Run tests
npm test
Project Structure
anysite-mcp-server/
├── src/ # Source code
│ ├── index.ts # MCP server entry point (Smithery runtime)
│ ├── server.ts # Server implementation (Traditional MCP)
│ └── types.ts # TypeScript type definitions
├── build/ # Compiled JavaScript
│ ├── index.js # Main entry point
│ ├── server.js # Server executable
│ ├── types.js # Type definitions
│ ├── remote-server.js # Remote server support
│ ├── streamable-server.js # Streaming support
│ └── smithery.js # Smithery integration
├── .claude/ # Claude Code settings
│ └── settings.local.json
├── .cursor/ # Cursor IDE settings
│ └── rules/
├── .smithery/ # Smithery CLI files
│ └── index.cjs
├── package.json # npm package configuration
├── package-lock.json
├── tsconfig.json # TypeScript configuration
├── smithery.yaml # Smithery config
├── glama.json # Glama integration
├── .env # Environment variables (local)
├── .npmrc # npm configuration
├── .gitignore
├── README.md # Documentation
├── CLAUDE.md # Claude Code instructions
├── LICENSE.md # MIT License
└── LICENSE
Contributing
We welcome contributions! See CONTRIBUTING.md for guidelines.
Areas we need help with:
- 📝 Documentation improvements
- 🐛 Bug fixes and testing
- ✨ New platform integrations
- 🌍 Translations
📊 Pricing & Limits
Free Tier
- ✅ 100 free credits on signup
- ✅ All 65+ tools available
- ✅ OAuth authentication
- ⚠️ Rate limits apply
Pro Plans
- 🚀 Higher rate limits
- 🚀 Priority support
- 🚀 Dedicated proxies
- 🚀 Team collaboration
See pricing details
🔒 Security & Privacy
- OAuth 2.0 - Industry-standard authentication
- No Credential Storage - Your API keys stay with Anysite
- Encrypted Transport - All data transmitted over HTTPS
- GDPR Compliant - Data processing follows EU regulations
- Revocable Access - One-click disconnect in dashboard
⚠️ Important: Always comply with platform terms of service and local regulations when scraping data.
💬 Community & Support
- 📖 Documentation
- 💬 Discord Community - Ask questions, share workflows
- 🐦 Twitter - Latest updates
- 📧 Email Support
- 🐛 GitHub Issues
📄 License
This project is licensed under the MIT License.
🙏 Acknowledgments
Built with:
- Model Context Protocol by Anthropic
- TypeScript
- Node.js
Special thanks to the MCP community for feedback and contributions.
⭐ Star us on GitHub if Anysite MCP Server helps your AI agents!
Made with ❤️ by the Anysite.io team