{
  "markdown": "<p align=\"center\">\n  <img src=\"docs/logo-animation.gif\" alt=\"fastCRW\" width=\"180\" />\n</p>\n\n<h1 align=\"center\">fastCRW</h1>\n\n<p align=\"center\">\n  Turn URLs into clean <strong>markdown</strong> or structured\n  <strong>JSON</strong> with one engine for search, scrape, map, crawl, and extract.\n</p>\n\n<p align=\"center\">\n  Run it locally as a small Rust binary or use the managed API.\n</p>\n\n<p align=\"center\">\n  <a href=\"https://fastcrw.com/register?ref=gh-hero\"><strong>Get 1000 free credits →</strong></a> ·\n  <a href=\"#one-command-install\"><strong>Install</strong></a> ·\n  <a href=\"https://docs.fastcrw.com\"><strong>Docs</strong></a>\n</p>\n\n<p align=\"center\">\n  <sub>No credit card. Continue with GitHub.</sub>\n</p>\n\n<p align=\"center\">\n  <a href=\"https://crates.io/crates/crw-server\"><img src=\"https://img.shields.io/crates/v/crw-server.svg\" alt=\"crates.io\"></a>\n  <a href=\"https://pypi.org/project/crw/\"><img src=\"https://img.shields.io/pypi/v/crw.svg?label=pypi\" alt=\"PyPI\"></a>\n  <a href=\"https://www.npmjs.com/package/crw-mcp\"><img src=\"https://img.shields.io/npm/v/crw-mcp.svg?label=npm%20mcp\" alt=\"npm crw-mcp\"></a>\n  <a href=\"https://github.com/us/crw/actions/workflows/ci.yml\"><img src=\"https://github.com/us/crw/actions/workflows/ci.yml/badge.svg?branch=main&event=push\" alt=\"CI\"></a>\n  <a href=\"LICENSE\"><img src=\"https://img.shields.io/badge/license-AGPL--3.0-blue.svg\" alt=\"License\"></a>\n  <a href=\"https://github.com/us/crw/stargazers\"><img src=\"https://img.shields.io/github/stars/us/crw?style=social\" alt=\"GitHub Stars\"></a>\n</p>\n\n## One-command install\n\n```bash\ncurl -fsSL https://fastcrw.com/install | sh\n```\n\nRuns local and free, no account needed. To use the Cloud, paste your key into\nthe same command and it installs the binary, connects the key, and registers the\nMCP server with the AI coding tools you already have:\n\n```bash\ncurl -fsSL https://fastcrw.com/install | CRW_API_KEY=crw_live_... sh\n```\n\n```bash\ncrw search \"rust tutorials\"\n```\n\nClaude Code, Cursor, Codex, Gemini CLI, OpenCode and Windsurf are picked up\nautomatically when they are already set up; nothing else is touched, and your\nkey stays in `~/.config/crw/config.toml` rather than being copied into each\ntool. Add `CRW_NO_AGENTS=1` to skip that step, or run `crw setup` on its own to\nchoose interactively.\n\n**1000 free credits, no credit card.** Managed proxies, JS rendering and search,\nwith nothing to run or keep up to date.\n[Get my free key →](https://fastcrw.com/register?ref=gh-quickstart)\n\nmacOS and Linux, Intel and ARM.\n[More install options →](https://docs.fastcrw.com/installation/)\n\n## What it does\n\n| Operation | Outcome |\n|---|---|\n| **Scrape** | One URL to markdown, HTML, links, screenshots, or schema JSON |\n| **Crawl** | Follow a bounded site crawl and collect its pages |\n| **Map** | Discover URLs without scraping every page |\n| **Search** | Search the web and optionally scrape selected results |\n| **Extract** | Produce structured fields from one or many URLs |\n\n[See the full API →](https://docs.fastcrw.com/#rest-api)\n\n## Why fastCRW\n\nOn Firecrawl's own public 1,000-URL dataset, fastCRW recovered more truth than\nCrawl4AI and Firecrawl, matched the fastest median latency, and idled at\n**~14 MB RAM**.\n\n<p align=\"center\">\n  <a href=\"BENCHMARKS.md\">\n    <img src=\".github/benchmarks/bench-radar.svg\" alt=\"fastCRW compared with Crawl4AI and Firecrawl on truth-recall, unique recoveries, median latency, download size, and recall depth\" width=\"100%\">\n  </a>\n</p>\n\n<p align=\"center\"><sub><a href=\"BENCHMARKS.md\">Methodology, full numbers, and how to reproduce it</a></sub></p>\n\nOn a different benchmark entirely, answer accuracy rather than scrape recall,\nfastCRW answers **90.0%** of the 600 AA-Omniscience questions correctly. Every\nproduct listed on the Artificial Analysis Search Index sits below it.\n\n<p align=\"center\">\n  <a href=\"https://fastcrw.com/benchmarks/aa-omniscience\">\n    <img src=\".github/benchmarks/bench-omniscience.svg\" alt=\"AA-Omniscience answer accuracy. fastCRW 90.0 percent, ahead of every product on the Artificial Analysis Search Index: Firecrawl 73, Exa 70, You.com 69, Parallel 68, Tavily 64, and 38 with no search at all.\" width=\"100%\">\n  </a>\n</p>\n\n<p align=\"center\"><sub><a href=\"https://fastcrw.com/benchmarks/aa-omniscience\">The full 14-product comparison, the control run, and how to reproduce it</a></sub></p>\n\n## Choose how you use it\n\n### CLI\n\n```bash\ncrw https://example.com            # scrape, works right after install\ncrw search \"rust async runtime\"    # search, after `crw setup`\n```\n\n### Python SDK\n\nUsing Cloud? [Get an API key](https://fastcrw.com/register?ref=gh-sdk), then export it once:\n\n```bash\nexport CRW_API_KEY=\"crw_live_...\"\npip install crw\n```\n\n```python\nfrom crw import CrwClient\n\nclient = CrwClient()\npage = client.scrape(\"https://example.com\", formats=[\"markdown\"])\n\nprint(page[\"markdown\"])\n```\n\n<details>\n<summary><strong>Node.js</strong></summary>\n\n```bash\nnpm install crw-sdk\n```\n\n```javascript\nimport { CrwClient } from \"crw-sdk\";\n\nconst client = new CrwClient();\n\nconst page = await client.scrape(\"https://example.com\", {\n  formats: [\"markdown\"],\n});\n\nconsole.log(page.markdown);\n```\n\n</details>\n\n[Local mode and more SDK examples →](https://docs.fastcrw.com/sdk-examples/) ·\n[REST API →](https://docs.fastcrw.com/#rest-api)\n\n### MCP for AI agents\n\n```bash\nnpx -y crw-mcp@latest install\n```\n\nInstalls the CRW skill and MCP server in your detected AI tools. `crw setup` can\nalso do this step, so either path is enough.\n[Manual setup →](https://docs.fastcrw.com/mcp-clients/)\n\n## Choose where it runs\n\n| | Managed API | Local / self-hosted |\n|---|---|---|\n| Best for | Zero infrastructure and managed scaling | Data control, private networks, or custom infrastructure |\n| Start | [Create an API key](https://fastcrw.com/register?ref=gh-table), then `crw setup` | Install and run `crw <URL>` |\n| Operations | Managed proxies, billing, and hosted capabilities | You choose renderers, search, auth, proxies, and capacity |\n\nCapabilities and response shapes can differ by deployment:\n[`/v1/capabilities`](https://docs.fastcrw.com/capabilities/) · [response shapes](https://docs.fastcrw.com/response-shapes/)\n\n[Self-hosting guide →](https://docs.fastcrw.com/self-hosting/)\n\n## Learn more\n\n- [Quickstart](https://docs.fastcrw.com/quick-start/)\n- [API reference](https://docs.fastcrw.com/#rest-api)\n- [Benchmarks](BENCHMARKS.md)\n- [Firecrawl migration](https://docs.fastcrw.com/migrate-from-firecrawl/)\n- [Self-hosting](https://docs.fastcrw.com/self-hosting/)\n\n## Contributing\n\nThe workspace requires Rust 1.85 or newer:\n\n```bash\ngit clone https://github.com/us/crw\ncd crw\nmake check-fast\n```\n\n[Read the contributor guide →](CONTRIBUTING.md)\n\nEngine and MCP server: [AGPL-3.0](LICENSE). Python and TypeScript SDKs: MIT.\nEmbedding license: hello@fastcrw.com.\n\n## Star History\n\n<a href=\"https://www.star-history.com/?repos=us%2Fcrw&type=date&legend=top-left\">\n <picture>\n   <source media=\"(prefers-color-scheme: dark)\" srcset=\"https://api.star-history.com/chart?repos=us/crw&type=date&theme=dark&legend=top-left&sealed_token=Pe6pRWL7lqTM-St9eo-Cmpk5kYNyuyun0krw9eVZQFIrm3g_R2h46IW6wfNalPXquMsWSNCgKqiar1YVo9MGy2IZmN5Lz6rjZcjBCw6bCcRHORKORFRi9A\" />\n   <source media=\"(prefers-color-scheme: light)\" srcset=\"https://api.star-history.com/chart?repos=us/crw&type=date&legend=top-left&sealed_token=Pe6pRWL7lqTM-St9eo-Cmpk5kYNyuyun0krw9eVZQFIrm3g_R2h46IW6wfNalPXquMsWSNCgKqiar1YVo9MGy2IZmN5Lz6rjZcjBCw6bCcRHORKORFRi9A\" />\n   <img alt=\"Star History Chart\" src=\"https://api.star-history.com/chart?repos=us/crw&type=date&legend=top-left&sealed_token=Pe6pRWL7lqTM-St9eo-Cmpk5kYNyuyun0krw9eVZQFIrm3g_R2h46IW6wfNalPXquMsWSNCgKqiar1YVo9MGy2IZmN5Lz6rjZcjBCw6bCcRHORKORFRi9A\" />\n </picture>\n</a>\n\n<details>\n<summary>Contributors</summary>\n\n<!-- contributors:start -->\n<p align=\"center\">\n  <a href=\"https://github.com/us\" title=\"us\"><img src=\"https://github.com/us.png?size=96\" width=\"48\" height=\"48\" alt=\"us\"/></a>\n  <a href=\"https://github.com/santhreal\" title=\"santhreal\"><img src=\"https://github.com/santhreal.png?size=96\" width=\"48\" height=\"48\" alt=\"santhreal\"/></a>\n  <a href=\"https://github.com/AsheTheWings\" title=\"AsheTheWings\"><img src=\"https://github.com/AsheTheWings.png?size=96\" width=\"48\" height=\"48\" alt=\"AsheTheWings\"/></a>\n  <a href=\"https://github.com/adambenhassen\" title=\"adambenhassen\"><img src=\"https://github.com/adambenhassen.png?size=96\" width=\"48\" height=\"48\" alt=\"adambenhassen\"/></a>\n  <a href=\"https://github.com/paoloantinori\" title=\"paoloantinori\"><img src=\"https://github.com/paoloantinori.png?size=96\" width=\"48\" height=\"48\" alt=\"paoloantinori\"/></a>\n  <a href=\"https://github.com/VIVAAN-DHAWAN\" title=\"VIVAAN-DHAWAN\"><img src=\"https://github.com/VIVAAN-DHAWAN.png?size=96\" width=\"48\" height=\"48\" alt=\"VIVAAN-DHAWAN\"/></a>\n  <a href=\"https://github.com/mj520\" title=\"mj520\"><img src=\"https://github.com/mj520.png?size=96\" width=\"48\" height=\"48\" alt=\"mj520\"/></a>\n</p>\n<!-- contributors:end -->\n\n</details>\n\n<sub>Please respect website policies. Crawl and map follow `robots.txt` by default.</sub>\n",
  "bytes": 9074,
  "sha": "19266f96c668557691cde488ebb80d97b892120cf21fba842051102e2f1eb035",
  "repo_slug": "us/crw",
  "fonte": "repo",
  "truncated": false,
  "api": "https://agentalog.com/api/listings/mcp_io_github_us_crw_d2d60bf3/readme"
}