{ "markdown": "# mcp-server-scraper\n\n[![npm version](https://img.shields.io/npm/v/mcp-server-scraper.svg)](https://www.npmjs.com/package/mcp-server-scraper)\n[![npm downloads](https://img.shields.io/npm/dm/mcp-server-scraper.svg)](https://www.npmjs.com/package/mcp-server-scraper)\n[![CI](https://github.com/ofershap/mcp-server-scraper/actions/workflows/ci.yml/badge.svg)](https://github.com/ofershap/mcp-server-scraper/actions/workflows/ci.yml)\n[![TypeScript](https://img.shields.io/badge/TypeScript-strict-blue.svg)](https://www.typescriptlang.org/)\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n[![Agent Plugins](https://img.shields.io/badge/Agent_Plugins-1.0.0-0ea5e9.svg)](https://agent-plugins.org)\n\nExtract clean, readable content from any URL. Returns markdown text, links, and metadata. No API keys, no config. A free alternative to Firecrawl for scraping docs, blogs, and articles.\n\n```bash\nnpx mcp-server-scraper\n```\n\n> Works with Claude Desktop, Cursor, VS Code Copilot, and any MCP client. No accounts or API keys needed.\n\n

\n \"Install\n  \n \"Add\n

\n\n![MCP server for web scraping, content extraction, and URL metadata](assets/demo.gif)\n\nDemo built with remotion-readme-kit\n\n## Why\n\nWhen you're working with an AI assistant and need to reference a docs page, a blog post, or an API reference, you usually end up copy-pasting content manually. Tools like Firecrawl solve this but require a paid API key. This server does the same thing for free. It fetches a URL, runs it through Mozilla Readability (the same engine behind Firefox Reader View), and returns clean markdown. It works well for server-rendered content like documentation sites, blog posts, and articles. It won't handle JavaScript-heavy SPAs, but for the most common use case of \"read this docs page and summarize it,\" it does the job.\n\n## Tools\n\n| Tool | What it does |\n| ------------------ | ---------------------------------------------------------------- |\n| `scrape_url` | Extract clean text content from a URL (Readability-powered) |\n| `extract_links` | Get all links with href and anchor text |\n| `extract_metadata` | Get title, description, OG tags, canonical, favicon |\n| `search_page` | Search for a query string within the page, return matching lines |\n| `scrape_multiple` | Batch scrape multiple URLs, get title + excerpt per URL |\n\n## Quick Start\n\n### Cursor\n\nAdd to `.cursor/mcp.json`:\n\n```json\n{\n \"mcpServers\": {\n \"scraper\": {\n \"command\": \"npx\",\n \"args\": [\"-y\", \"mcp-server-scraper\"]\n }\n }\n}\n```\n\n### Claude Desktop\n\nAdd to `claude_desktop_config.json`:\n\n```json\n{\n \"mcpServers\": {\n \"scraper\": {\n \"command\": \"npx\",\n \"args\": [\"-y\", \"mcp-server-scraper\"]\n }\n }\n}\n```\n\n### VS Code\n\nAdd to your MCP settings (e.g. `.vscode/mcp.json`):\n\n```json\n{\n \"mcp\": {\n \"servers\": {\n \"scraper\": {\n \"command\": \"npx\",\n \"args\": [\"-y\", \"mcp-server-scraper\"]\n }\n }\n }\n}\n```\n\n## Examples\n\n- \"Scrape the API docs from https://docs.example.com and summarize them\"\n- \"Extract all links from this page\"\n- \"What's the OG image and description for this URL?\"\n- \"Search this page for mentions of 'authentication'\"\n- \"Scrape these 5 URLs and give me a summary of each\"\n\n## How it works\n\nUses [Mozilla Readability](https://github.com/mozilla/readability) (the engine behind Firefox Reader View) plus [linkedom](https://github.com/WebReflection/linkedom) for fast HTML parsing in Node. No headless browser needed. Works best with server-rendered pages: docs, blogs, articles, news sites.\n\n## Agent Plugins\n\nThis repo is an [Agent Plugins](https://agent-plugins.org) 1.0.0 package: `plugin.json`, portable `mcp.json`, and `skills/` ship together with the MCP server.\n\nFor Cursor, clone the repo and copy or symlink it to `~/.cursor/plugins/local/mcp-server-scraper`, then reload the window. Skills and MCP show up under Customize > Plugins.\n\nThe Cursor and VS Code install buttons above still work: they add the same `npx -y mcp-server-scraper` stdio server as manual JSON.\n\n## FAQ\n\n### What is mcp-server-scraper?\n\nA free MCP server that turns public web pages into clean markdown using Mozilla Readability. No Firecrawl or other scrape API key.\n\n### Does it run JavaScript or SPAs?\n\nNo. It fetches HTML and parses it in Node. Use a browser MCP for React dashboards and other client-rendered sites.\n\n### How is this different from Firecrawl?\n\nFirecrawl is a hosted scrape API with billing. This server runs locally via `npx`, costs nothing, and fits doc/blog/article URLs.\n\n### Can I install it as an Agent Plugin in Cursor?\n\nYes. Use the local plugin path under `~/.cursor/plugins/local/mcp-server-scraper` so the bundled `web-scraping` skill loads with the MCP config.\n\n### Do I need API keys or env vars?\n\nNo. Point your MCP client at `npx -y mcp-server-scraper` only.\n\n## Development\n\n```bash\nnpm install\nnpm run typecheck\nnpm run build\nnpm test\n```\n\n## See also\n\nMore MCP servers and developer tools on my [portfolio](https://gitshow.dev/ofershap).\n\n## Author\n\n[![Made by ofershap](https://gitshow.dev/api/card/ofershap)](https://gitshow.dev/ofershap)\n\n[![LinkedIn](https://img.shields.io/badge/LinkedIn-Connect-0A66C2?style=flat&logo=linkedin&logoColor=white)](https://linkedin.com/in/ofershap)\n[![GitHub](https://img.shields.io/badge/GitHub-Follow-181717?style=flat&logo=github&logoColor=white)](https://github.com/ofershap)\n\n---\n\nREADME built with [README Builder](https://ofershap.github.io/readme-builder/)\n\n## License\n\n[MIT](LICENSE) © [Ofer Shapira](https://github.com/ofershap)\n", "bytes": 6324, "sha": "ee8460cfe627724c28b8a260328fc0561bfd6f458ba40d3714808762197fc39c", "repo_slug": "ofershap/mcp-server-scraper", "fonte": "repo", "truncated": false, "api": "https://agentalog.com/api/listings/mcp_io_github_ofershap_scraper_86fd2fd7/readme" }