Overview
WhizoAI provides a Model Context Protocol (MCP) server that enables seamless integration with Claude Desktop and other MCP-compatible AI tools. This allows you to use WhizoAI’s web scraping, crawling, and data extraction capabilities directly within your AI assistant conversations.MCP Server Package:
whizoai-mcp - Published on npmPrerequisites
- Node.js 18 or higher
- WhizoAI API key (Get your API key)
- Claude Desktop or another MCP-compatible tool
Quick Setup
1. Get Your API Key
- Log in to your WhizoAI Dashboard
- Navigate to API Keys
- Copy your existing API key or create a new one
2. Configure Claude Desktop
Add the following configuration to your Claude Desktop config file: macOS:~/Library/Application Support/Claude/claude_desktop_config.json
Windows: %APPDATA%\Claude\claude_desktop_config.json
3. Restart Claude Desktop
After saving the configuration file, restart Claude Desktop to load the MCP server.4. Verify Installation
In Claude Desktop, you should now see the WhizoAI MCP server listed in the available tools. You can verify by asking:Available Tools
The WhizoAI MCP server provides 10 powerful tools:Core Scraping Tools
whizoai_scrape
Scrape single or multiple webpages (1-100 URLs) with native multi-URL support and automatic parallelization
whizoai_crawl
Crawl multiple pages from a website with depth and page limits
whizoai_extract
AI-powered data extraction using structured schemas
whizoai_search
Perform web searches and get scraped content from results
whizoai_screenshot
Capture high-quality screenshots with custom viewport sizes and mobile/desktop modes
Job Management Tools
whizoai_job_status
Check the status of a running job
whizoai_list_jobs
List recent jobs with filtering options
whizoai_cancel_job
Cancel a running or pending job
Account Tools
whizoai_check_credits
Check your remaining credit balance
whizoai_map
Discover URLs from a website (map structure)
Usage Examples
Example 1: Simple Web Scraping
Example 2: Multi-URL Scraping
New in v2.2.1: Native multi-URL support directly in the scrape tool! Process 1-100 URLs in a single request with automatic parallelization.
- Process 1-100 URLs in a single request
- Automatic parallelization for faster results
- Background job processing with progress tracking
- Use
whizoai_get_jobtool to monitor progress and retrieve results - All scraping options work with multi-URL (screenshots, PDFs, etc.)
Example 3: Multi-Page Crawling
Example 3: Structured Data Extraction
Example 4: Web Search with Content
Example 5: Screenshot Capture
- Mobile mode: Emulate mobile device with appropriate viewport and user agent
- Desktop mode: Standard desktop viewport (default)
- Custom viewport: Specify exact width and height (320-3840 x 240-2160)
- Full page: Capture entire page or just visible viewport
- Wait time: Wait for dynamic content to load before capturing
Configuration Options
Custom API URL
If you’re using a self-hosted WhizoAI instance or testing locally, you can specify a custom API URL:Multiple Environments
You can configure multiple WhizoAI MCP servers for different environments:Features
✅ 10 Powerful Tools - Comprehensive web scraping and data extraction capabilities ✅ Screenshot Capture - High-quality screenshots with mobile/desktop modes ✅ Real-time Job Status - Monitor long-running scraping jobs ✅ Credit Management - Check your credit balance directly from Claude ✅ Easy Installation - One-line setup with npx ✅ Automatic Updates - Always uses the latest version with-y flag
✅ Secure - API key-based authentication
Credit Usage
MCP tool calls consume credits from your WhizoAI account based on the operation:| Tool | Base Cost | Additional |
|---|---|---|
whizoai_scrape | 1 credit | +1 for screenshot, +1 for PDF |
whizoai_screenshot | 1 credit | Per screenshot captured |
whizoai_crawl | 1 credit/page | Depends on pages crawled |
whizoai_extract | 3-6 credits/page | Based on AI model used |
whizoai_search | 1 credit | Per search query |
whizoai_map | 1 credit | Per discovery request |
| Other tools | Free | No credit cost |
Troubleshooting
MCP Server Not Loading
- Check Configuration Path: Ensure you’re editing the correct config file
- Validate JSON: Use a JSON validator to check for syntax errors
- Restart Claude: Completely quit and restart Claude Desktop
- Check Logs: View MCP server logs in Claude Desktop’s developer console
API Key Issues
- Verify API Key: Ensure your API key is active in the Dashboard
- Check Format: API keys should start with
wai_ - Permissions: Ensure the key has appropriate permissions
Connection Errors
- Network: Verify you have internet connectivity
- Firewall: Check if firewall is blocking npx or Node.js
- API Status: Check status.whizo.ai for service health
Best Practices
Optimize Credit Usage
Optimize Credit Usage
- Use
onlyMainContent: truefor scraping to reduce costs - Limit crawl depth and pages to only what you need
- Use
whizoai_mapto discover URLs before crawling - Cache results when possible
Handle Rate Limits
Handle Rate Limits
- Monitor your plan’s rate limits in the dashboard
- Use batch operations instead of sequential individual requests
- Implement exponential backoff for retries
- Upgrade your plan if you consistently hit limits
Secure Your API Key
Secure Your API Key
- Never commit API keys to version control
- Rotate API keys periodically
- Use separate keys for development and production
- Revoke unused or compromised keys immediately
Advanced Usage
Using with Other MCP Clients
While this guide focuses on Claude Desktop, the WhizoAI MCP server works with any MCP-compatible client:Local Development
For local development and testing:Support
Need help with the MCP integration?- Documentation: docs.whizo.ai
- Email Support: [email protected]
- GitHub Issues: github.com/whizoai
- Status Page: status.whizo.ai