{
  "markdown": "<!-- mcp-name: io.github.jlucasmcrell/apify-scrapers -->\nmcp-name: io.github.jlucasmcrell/apify-scrapers\n# Apify Public Data Scrapers & Extractors\n\n[![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/)\n[![Node.js 18+](https://img.shields.io/badge/node-18+-green.svg)](https://nodejs.org/)\n[![Apify Verified](https://img.shields.io/badge/apify-store-orange.svg)](https://apify.com/captainhandsome)\n[![Glama MCP Server](https://glama.ai/mcp/servers/jlucasmcrell/apify-scrapers/badge)](https://glama.ai/mcp/servers/jlucasmcrell/apify-scrapers)\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n\nA curated collection of reliable, production-ready scrapers and public-data extractors hosted on the **[Apify Store](https://apify.com/captainhandsome)**. \n\nEach actor is built with strict schema validation, deterministic field mapping, self-healing DOM selectors, and pay-per-event pricing starting at **$0.0002 / start**.\n\n---\n\n## Quick Navigation\n\n- [Available Extractors & Store Listings](#available-extractors--store-listings)\n- [Python Quickstart](#python-quickstart)\n- [Node.js Quickstart](#nodejs-quickstart)\n- [No-Code & Automation Workflows (n8n, Sheets, Slack)](#no-code--automation-workflows)\n- [Pre-Built Example Tasks (Zero Code)](#pre-built-example-tasks-zero-code)\n- [Free Sample Datasets](#free-sample-datasets)\n- [AI Agent & MCP Integration (Claude Desktop, Cursor, Custom Agent)](#ai-agent--mcp-integration)\n- [In-Depth Engineering Guides](#in-depth-engineering-guides)\n- [Repository Structure](#repository-structure)\n- [Contributing & Author](#author--support)\n\n---\n\n## Available Extractors & Store Listings\n\n| Tool | Store Link | Key Output Fields | Best For |\n|---|---|---|---|\n| **Google Maps Business Leads** | [`captainhandsome/google-maps-business-search`](https://apify.com/captainhandsome/google-maps-business-search) | Name, phone, website, rating, reviews, address, coordinates, hours | B2B lead generation, local agency prospecting |\n| **Glassdoor Jobs & Salaries** | [`captainhandsome/glassdoor-jobs-scraper`](https://apify.com/captainhandsome/glassdoor-jobs-scraper) | Title, company, salary estimate, rating, location, job URL, posting date | Hiring intelligence, compensation benchmarking |\n| **Airbnb Vacation Rentals** | [`captainhandsome/airbnb-listings-search`](https://apify.com/captainhandsome/airbnb-listings-search) | Title, room type, nightly price, rating, reviews count, listing URL | Real estate research, market rate tracking |\n| **SEC EDGAR Corporate Filings** | [`captainhandsome/sec-edgar-filings-search`](https://apify.com/captainhandsome/sec-edgar-filings-search) | Ticker, CIK, form (10-K, 10-Q, 8-K), filing date, primary document URL | Financial diligence, equity research, compliance |\n| **USAspending Federal Awards** | [`captainhandsome/usaspending-federal-awards`](https://apify.com/captainhandsome/usaspending-federal-awards) | Recipient vendor, award amount, awarding agency, description, dates | Government contracting, procurement intel |\n| **LinkedIn Public Jobs** | [`captainhandsome/linkedin-public-jobs-search`](https://apify.com/captainhandsome/linkedin-public-jobs-search) | Job title, employer, location, direct apply URL, posting age | Recruitment, tech talent monitoring |\n| **Google Play App Reviews** | [`captainhandsome/google-play-reviews-scraper`](https://apify.com/captainhandsome/google-play-reviews-scraper) | Review text, star score, thumbs up, date, reviewer name | App store sentiment, competitor feedback |\n| **YouTube Video Search** | [`captainhandsome/youtube-search-scraper`](https://apify.com/captainhandsome/youtube-search-scraper) | Title, video URL, channel, views count, duration, publish date | Content tracking, creator outreach |\n| **Twitch Live Streams** | [`captainhandsome/twitch-live-streams-scraper`](https://apify.com/captainhandsome/twitch-live-streams-scraper) | Streamer username, title, viewer count, language, category | Esports analytics, live stream monitoring |\n| **US Contractor Licenses** | [`captainhandsome/us-contractor-license-search`](https://apify.com/captainhandsome/us-contractor-license-search) | Contractor name, license number, classification, status, state | Trades verification, subcontractor diligence |\n| **US Business Entity Registries** | [`captainhandsome/us-business-entity-search`](https://apify.com/captainhandsome/us-business-entity-search) | Legal entity name, filing number, jurisdiction, status | Legal due diligence, corporate registration checks |\n\n---\n\n## Python Quickstart\n\n### 1. Install dependencies\n\n```bash\npip install apify-client pandas python-dotenv\n```\n\n### 2. Export 50 Google Maps Leads to CSV\n\n```python\nimport os\nfrom apify_client import ApifyClient\nimport pandas as pd\n\n# Get your API token from https://console.apify.com/account/integrations\nclient = ApifyClient(os.getenv(\"APIFY_TOKEN\"))\n\n# Run the actor\nrun = client.actor(\"captainhandsome/google-maps-business-search\").call(run_input={\n    \"search_query\": \"commercial electricians\",\n    \"location\": \"Dallas, Texas\",\n    \"max_items\": 50,\n    \"include_details\": True,\n})\n\n# Fetch dataset items and export to CSV\nitems = list(client.dataset(run[\"defaultDatasetId\"]).iterate_items())\ndf = pd.DataFrame(items)\ndf.to_csv(\"dallas_electricians.csv\", index=False)\nprint(f\"Exported {len(df)} leads to dallas_electricians.csv\")\n```\n\nSee [examples/google_maps_leads_to_csv.py](examples/google_maps_leads_to_csv.py) for the full script.\n\n---\n\n## Node.js Quickstart\n\n### 1. Install dependencies\n\n```bash\nnpm install apify-client\n```\n\n### 2. Query SEC EDGAR Filings\n\n```javascript\nimport { ApifyClient } from 'apify-client';\n\nconst client = new ApifyClient({ token: process.env.APIFY_TOKEN });\n\nconst run = await client.actor('captainhandsome/sec-edgar-filings-search').call({\n  companies: ['AAPL', 'NVDA', 'MSFT'],\n  forms: ['10-K'],\n  max_items: 15,\n});\n\nconst { items } = await client.dataset(run.defaultDatasetId).listItems();\nitems.forEach(filing => {\n  console.log(`[${filing.ticker}] ${filing.form} (${filing.filing_date}): ${filing.primary_document_url}`);\n});\n```\n\nSee [examples/sec_filings.js](examples/sec_filings.js) for the full script.\n\n---\n\n## No-Code & Automation Workflows\n\nIf you automate via n8n, Make, Zapier, or Google Sheets, ready-to-import blueprints are included in [`workflows/`](workflows/):\n\n- **[Google Maps Leads to Google Sheets (n8n)](workflows/n8n_google_maps_to_sheets.json):** Daily automated cron scrape piping HVAC/trade leads directly into Google Sheets with deduplication.\n- **[SEC EDGAR 10-K & 8-K Alerts to Slack (n8n)](workflows/n8n_sec_edgar_to_slack.json):** Hourly monitor alerting Slack or Discord when watchlisted public companies drop new filings.\n\n---\n\n## Pre-Built Example Tasks (Zero Code)\n\nIf you prefer runnable web UI tasks without writing any code, each actor includes pre-configured tasks published on Apify Store:\n\n### Google Maps Leads\n- [Phoenix HVAC Company Leads](https://apify.com/captainhandsome/google-maps-business-search/tasks/phoenix-hvac-company-leads)\n- [Dallas Commercial Electrician Leads](https://apify.com/captainhandsome/google-maps-business-search/tasks/dallas-commercial-electrician-leads)\n- [Chicago Italian Restaurants & Reviews](https://apify.com/captainhandsome/google-maps-business-search/tasks/chicago-italian-restaurants)\n\n### Glassdoor Jobs\n- [Austin Software Engineer Jobs](https://apify.com/captainhandsome/glassdoor-jobs-scraper/tasks/austin-software-engineer-jobs)\n- [Remote Product Manager Jobs](https://apify.com/captainhandsome/glassdoor-jobs-scraper/tasks/remote-product-manager-jobs)\n- [New York Data Scientist Postings](https://apify.com/captainhandsome/glassdoor-jobs-scraper/tasks/new-york-data-scientist-jobs)\n\n### Airbnb Rentals\n- [Nashville Vacation Rental Listings](https://apify.com/captainhandsome/airbnb-listings-search/tasks/nashville-vacation-rentals)\n- [Miami Beach Condos & Apartments](https://apify.com/captainhandsome/airbnb-listings-search/tasks/miami-beach-condos)\n- [Austin Downtown Rental Market](https://apify.com/captainhandsome/airbnb-listings-search/tasks/austin-airbnb-listings)\n\n### YouTube & Google Play\n- [Small Business Marketing Videos](https://apify.com/captainhandsome/youtube-search-scraper/tasks/small-business-marketing-videos)\n- [Python Web Scraping Tutorials](https://apify.com/captainhandsome/youtube-search-scraper/tasks/python-web-scraping-tutorials)\n- [Instagram 1-Star Play Store Reviews](https://apify.com/captainhandsome/google-play-reviews-scraper/tasks/instagram-one-star-reviews)\n\n---\n\n## Free Sample Datasets\n\nLooking for clean data to benchmark, analyze, or train models? Verified sample bundles with metadata schemas are available in [`datasets/`](datasets/) and hosted publicly on Hugging Face Datasets:\n\n1. **Phoenix HVAC Contractor Leads:** [`datasets/phoenix_hvac_leads/`](datasets/phoenix_hvac_leads/) | [Hugging Face Hub](https://huggingface.co/datasets/joeygambino/phoenix-hvac-contractor-leads) (20 verified HVAC contractor profiles with ratings, addresses, and phone numbers).\n2. **California Licensed Contractors:** [`datasets/california_solar_contractors/`](datasets/california_solar_contractors/) | [Hugging Face Hub](https://huggingface.co/datasets/joeygambino/california-licensed-contractors) (Active C-46 and B licensed solar installers with state verification numbers).\n3. **Austin Software Engineer Postings:** [`datasets/austin_software_jobs/`](datasets/austin_software_jobs/) | [Hugging Face Hub](https://huggingface.co/datasets/joeygambino/austin-software-engineer-jobs) (Normalized job listings with estimated posting dates and salary ranges).\n\n---\n\n## AI Agent & MCP Integration\n\nAll actors in this repository conform to OpenAPI and JSON Schema standards, making them directly callable by AI agents via the Model Context Protocol (MCP):\n\n### Option 1: Claude Desktop / Cursor with UVX (Recommended)\n\nAdd this to your `claude_desktop_config.json` or Cursor MCP settings:\n\n```json\n{\n  \"mcpServers\": {\n    \"apify-data-scrapers\": {\n      \"command\": \"uvx\",\n      \"args\": [\"apify-data-scrapers\"],\n      \"env\": {\n        \"APIFY_TOKEN\": \"YOUR_APIFY_API_TOKEN\"\n      }\n    }\n  }\n}\n```\n\n### Option 2: Docker Container (Glama / Cloud)\n\nRun via Docker:\n\n```json\n{\n  \"mcpServers\": {\n    \"apify-data-scrapers\": {\n      \"command\": \"docker\",\n      \"args\": [\"run\", \"-i\", \"--rm\", \"-e\", \"APIFY_TOKEN\", \"glcr.b-cdn.net/jlucasmcrell/apify-scrapers:latest\"],\n      \"env\": {\n        \"APIFY_TOKEN\": \"YOUR_APIFY_API_TOKEN\"\n      }\n    }\n  }\n}\n```\n\n### Option 3: Local Python Stdio Runner\n\nInstall via pip or run directly:\n\n```bash\npip install apify-data-scrapers\nexport APIFY_TOKEN=\"your_token_here\"\napify-data-scrapers\n```\n\nOr from local source:\n```bash\npython mcp_server.py\n```\n\n### Agent Prompts That Work Out-of-the-Box:\n- *\"Search Google Maps for 50 commercial roofers in Atlanta with phone numbers and websites.\"*\n- *\"Retrieve Apple and Microsoft Form 10-K filings from SEC EDGAR for the last 2 years.\"*\n- *\"Search Glassdoor for remote product manager jobs with salary estimates.\"*\n\n---\n\n## In-Depth Engineering Guides\n\nTechnical case studies and problem-solution writeups are located in [`articles/`](articles/):\n\n- **[Bypassing Playwright Headless Pagination Hurdles on Airbnb](articles/airbnb_playwright_pagination_guide.md):** How to solve sticky overlay modal interruptions and viewport boundary clipping in large headless browser crawls.\n- **[Extracting & Normalizing Clean Job Posting Dates from Glassdoor](articles/glassdoor_posting_dates_guide.md):** Overcoming relative timestamp drift (\\\"24h\\\", \\\"3d\\\", \\\"30d+\\\") with deterministic parsing and ISO-8601 boundary tracking.\n\n---\n\n## Repository Structure\n\n```text\napify-scrapers/\n README.md                                # Documentation and quickstart\n LICENSE                                  # MIT License\n requirements.txt                         # Python client dependencies\n package.json                             # Node.js dependencies\n mcp.json                                 # MCP tool registry specification\n mcp_server.py                            # Native Python stdio MCP server\n articles/                                # In-depth engineering case studies\n    airbnb_playwright_pagination_guide.md\n    glassdoor_posting_dates_guide.md\n    reddit_community_responses.md        # Reference technical answers for forums\n datasets/                                # Sample benchmark datasets\n    phoenix_hvac_leads/\n    california_solar_contractors/\n    austin_software_jobs/\n workflows/                               # No-code automation templates\n    n8n_google_maps_to_sheets.json\n    n8n_sec_edgar_to_slack.json\n    README.md\n examples/                                # Standalone developer scripts\n     google_maps_leads_to_csv.py\n     sec_edgar_filings_downloader.py\n     glassdoor_jobs_tracker.py\n     airbnb_market_scraper.py\n     usaspending_defense_awards.py\n     twitch_live_stream_monitor.py\n     google_maps_leads.js\n     sec_filings.js\n```\n\n---\n\n## Author & Support\n\nMaintained by **[Joseph McRell](https://apify.com/captainhandsome)**.\n\n- **Apify Store:** [https://apify.com/captainhandsome](https://apify.com/captainhandsome)\n- **GitHub:** [@jlucasmcrell](https://github.com/jlucasmcrell)\n- **Hugging Face:** [@joeygambino](https://huggingface.co/joeygambino)\n- **Issues & Requests:** Please open an issue on this repository or submit a ticket on the respective Apify Actor Store page.\n\n---\n\n## License\n\nThis project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.\n\n",
  "bytes": 13626,
  "sha": "a2b1a107e28f778a0a54c0534bca33dcbf161fe40f9764e50b5121688541ee70",
  "repo_slug": "jlucasmcrell/apify-scrapers",
  "fonte": "repo",
  "truncated": false,
  "api": "https://agentalog.com/api/listings/mcp_io_github_jlucasmcrell_apify_scrapers_51f80465/readme"
}