{
  "markdown": "<div align=\"center\">\n\n# DLBrowser\n\n### Your AI agent is blind to the half of the web that fights back.\n\nCloudflare, captchas, and JavaScript walls block the tools agents use to browse — silently.\n**DLBrowser is the one that gets through.** One line. Self-healing. Metered to the credit.\n\n[![PyPI](https://img.shields.io/pypi/v/dlbrowser)](https://pypi.org/project/dlbrowser/)\n[![npm](https://img.shields.io/npm/v/dlbrowser)](https://www.npmjs.com/package/dlbrowser)\n[![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](./LICENSE)\n[![Python](https://img.shields.io/pypi/pyversions/dlbrowser)](https://pypi.org/project/dlbrowser/)\n\n```bash\nnpx dlbrowser connect --key dlb_xxx\n```\n\n*Wires DLBrowser into Claude Code, Cursor, Windsurf, Cline & Codex in one command.\nYour agent gets 11 web tools that actually reach the page.*\n\n</div>\n\n---\n\n## The 60-second try\n\n```bash\npip install dlbrowser\ndlbrowser fetch https://example.com\n```\n\nEvery fetch tells you **which backend got through and how long it took** — because the\nengine picks the cheapest one that works and only escalates when a site fights back:\n\n```json\n{ \"success\": true, \"backend\": \"curl_cffi\", \"load_time\": 0.03, \"blocked\": false }\n```\n\nAnd every run is metered against a plan, in the open — no surprise invoice:\n\n```json\n{ \"plan\": \"scout\", \"remaining_daily\": 497, \"remaining_monthly\": 2497,\n  \"upgrade_url\": \"https://dekryptlabs.github.io/dlbrowser/pricing.html\" }\n```\n\nThat's a real response from the live gateway. Start free — 2,500 credits, no card.\n\n---\n\n## Why your agent needs this\n\nYou wire web access into an agent. It works in the demo. Then it meets the real web:\n\n- One site loads with a 50ms HTTP request. The next is an empty React shell until JS runs.\n- Cloudflare and DataDome quietly serve your headless browser a challenge page.\n- Your agent's built-in fetch returns `\"\"` — not an error, an **empty string** — and keeps going.\n- You have no idea which sites failed, which backend would've worked, or what any of it cost.\n\nDLBrowser is the capability layer that fixes this. Not a scraper. Not a crawler.\n**Acquisition infrastructure for AI agents** — reliable, observable, billable.\n\n---\n\n## The engine: start cheap, escalate only when blocked\n\n```\ncurl_cffi  →  tls_client  →  playwright  →  nodriver (CDP)  →  firecrawl\n  ~50ms         ~200ms        full JS        max stealth       last resort\n  HTTP-level, no browser       │            browser-level, real Chromium\n                               └── auto-escalates when a block is detected\n```\n\n~70% of real fetches never need a browser. Starting with a 50ms request and climbing the\nladder only on a detected block keeps you fast and cheap — while still getting through the\nsites that stop everything else. **Five backends.** Firecrawl has two. Crawl4AI has one.\n\n---\n\n## What resets your expectations\n\n| | |\n|---|---|\n| 🔁 **Self-healing fallback** | Five backends auto-escalate on block. Your agent stops getting an empty string. |\n| 💸 **Per-run cost telemetry** | Every run logs backend, credits, and estimated cost to a queryable ledger. **No competitor exposes this.** Your CFO can finally answer \"what does our web data cost?\" |\n| 🪙 **Token-efficient** | Returns clean markdown/extracted content, not raw HTML — **~4× fewer tokens** into your agent's context on content pages ([measured](#fewer-tokens-cleaner-signal)). Lower API cost, more window, better signal. |\n| 🎯 **No JS multipliers** | 1 credit per page on *any* backend. Firecrawl & ScrapingBee charge 5–7× for JS rendering. |\n| 🔒 **Atomic metering** | Reservation-based — **0% overshoot**, even under concurrency. You're never billed past your quota. |\n| 🧠 **LLM extraction** | Natural language → structured JSON. Runs against a local/free model — no cloud key required. |\n| 📦 **MIT, self-hostable** | Full feature parity self-hosted. Your data never leaves your infra. The hosted gateway just saves you running proxies + captcha infra. |\n| 🔌 **MCP-native** | 11 tools with use-first descriptions, so your agent reaches for DLBrowser over its flaky built-in browser. |\n\n---\n\n## Fewer tokens, cleaner signal\n\nRaw HTML pours tags, scripts, and boilerplate into your agent's context — you pay tokens\nfor noise, and the model burns attention parsing `<div class>` soup. DLBrowser returns\nclean **markdown** or extracted content instead.\n\nReal measurement through the live gateway — a Wikipedia article:\n\n| Mode | Tokens (approx) | vs raw HTML |\n|------|-----------------|-------------|\n| Raw HTML | ~57,000 | — |\n| **Markdown** | **~13,000** | **~77% fewer** |\n| Article | ~42,000 | ~27% fewer |\n\n**~4× less context per fetch on a content page** — lower API cost, more room in the\nwindow, and better signal for the model to reason over. Savings vary by page (a sparse\nlink list saves little, and your agent picks the mode) — so measure your own:\n\n```python\nimport asyncio, tiktoken\nfrom hermes_browser import fetch          # pip install dlbrowser\nenc = tiktoken.get_encoding(\"cl100k_base\")\nraw = asyncio.run(fetch(url, mode=\"html\"))[\"content\"][\"html\"]\nmd  = asyncio.run(fetch(url, mode=\"markdown\"))[\"content\"][\"markdown\"]\nprint(len(enc.encode(raw)), \"→\", len(enc.encode(md)), \"tokens\")\n```\n\n## One line, every host\n\n```bash\nnpx dlbrowser connect --key dlb_xxx\n# detects and configures: claude-code · claude-desktop · cursor · windsurf · cline · codex\n```\n\nOr point any MCP client at the **free hosted demo** gateway (try it with no local setup —\nsome features are gated on the demo; self-host for the full engine):\n\n```bash\nclaude mcp add dlbrowser --transport http \\\n  --url https://api.dekryptlabs.com \\\n  --header \"Authorization: Bearer dlb_xxx\"\n```\n\nYour agent immediately has: `fetch` · `scrape` · `smart_extract` · `screenshot` ·\n`markdown` · `crawl` · `search` · `serp` · `status` · `account` · `topup`.\n\n---\n\n## Can I trust it? (architecture)\n\n```\nAgent / CLI / Extension / MCP client\n        │\n   ┌────┴─────┐\n   │ Gateway  │  Paywalled — 401 no key · 402 over quota · free: status/account\n   └────┬─────┘\n   ┌────┴─────┐\n   │  Router  │  Adaptive per-domain scoring: success · latency · cost · freshness\n   └────┬─────┘\n   ┌────┴─────────────────────────────┐\n   │  curl_cffi → tls → playwright →  │  self-healing cascade\n   │  nodriver → firecrawl            │\n   └────┬─────────────────────────────┘\n   ┌────┴─────┐\n   │  Ledger  │  per-run backend · credits · cost · trace_id (OpenTelemetry)\n   └──────────┘\n```\n\nThe router learns per-domain — more usage, better routing. Everything above the gateway is\n**MIT and self-hostable**. Read the code before you trust it; that's the point of open source.\n\n---\n\n## Can it beat Cloudflare?\n\nOn many real sites, **with no browser at all.** We tested 5 Cloudflare-protected sites from\na datacenter IP with no residential proxy (worst case):\n\n| Site | Result | How |\n|------|--------|-----|\n| nowsecure.nl (CF challenge test) | ✅ pass | TLS impersonation |\n| crunchbase.com | ✅ pass | curl_cffi, 0.3s, no browser |\n| nike.com | ✅ pass | curl_cffi, 1.2s, no browser |\n| g2.com | ❌ 403 | Cloudflare Enterprise — datacenter IP blocked by reputation |\n| zillow.com | ❌ 403 | Enterprise + captcha — needs residential IP |\n\n**3/5 passed on HTTP-level TLS impersonation alone.** The two failures weren't fingerprint\nfailures — they're IP-reputation blocks that need residential-proxy routing (supported,\ndisabled in this test). No tool beats Cloudflare universally; DLBrowser's answer is layered\nescalation. Full methodology + \"what beating Cloudflare actually means\" →\n[marketing/cloudflare.md](./marketing/cloudflare.md).\n\nWe have **not** published broad head-to-head benchmarks vs Firecrawl/Crawl4AI yet — those\nare next, with the methodology published alongside. We don't print numbers we made up.\n**Don't trust our table — run it on your own hardest sites:**\n\n```bash\npip install \"dlbrowser[full]\" && python3 -m playwright install chromium\ndlbrowser fetch <a-url-that-blocks-your-current-tool>   # see the backend that got through\n```\n\n---\n\n## Pricing\n\n| Plan | Price | Credits | Daily cap | Backends | Captcha | Proxy | LLM | Keys |\n|------|-------|---------|-----------|----------|---------|-------|-----|------|\n| **Scout** | Free | 2,500 one-time | 500 | curl_cffi | — | — | — | 1 |\n| **Analyst** | $29/mo | 100,000/mo | 5,000 | + tls_client | — | — | 50k | 3 |\n| **Operator** | $85/mo | 500,000/mo | 25,000 | + playwright | ✓ | — | 200k | 10 |\n| **Command** | $299/mo | 2,000,000/mo | 100,000 | all + nodriver | ✓ | ✓ | 1M | 50 |\n| **Enterprise** | from $999/mo | 10M–100M+/mo | — | all + dedicated | ✓ | ✓ | ∞ | ∞ |\n\n1 credit = 1 page, any backend. Annual 20% off. Self-hosting is free forever.\nFull pricing → [PRICING.md](./PRICING.md) · hosted: [dekryptlabs.github.io/dlbrowser/pricing.html](https://dekryptlabs.github.io/dlbrowser/pricing.html)\n\n---\n\n## Will my company approve it?\n\n- **Multi-tenant** — organizations, teams, seats, roles\n- **API keys** — create, revoke, rotate, scope, expire (SHA-256 hashed)\n- **Audit logs** — immutable event ledger: who did what, when, at what cost\n- **Webhooks** — HMAC-SHA256 signed, with a dead-letter queue\n- **SLA monitoring** — scheduled page diffing with noise-tolerant change detection\n- **Self-hosted** — Docker one-liner, full feature parity, data stays in your network\n\nEnterprise plans publish real prices (from $999/mo) — no \"call us\" black box. `sales@dekryptlabs.com`\n\n---\n\n## When *not* to use DLBrowser\n\n- You need **pre-built datasets** → Bright Data / Apify\n- You need a **visual scraping IDE** → Octoparse\n- You need **screenshot-as-a-service** → Urlbox\n\nDLBrowser is for teams running AI agents that need reliable, observable, cost-controlled\nweb access at scale.\n\n---\n\n## Docs\n\n| Resource | Link |\n|----------|------|\n| Getting Started | [GETTING_STARTED.md](./GETTING_STARTED.md) |\n| Integrations (LangChain / LlamaIndex) | [INTEGRATION_QUICKSTART.md](./INTEGRATION_QUICKSTART.md) |\n| Self-Hosted Deploy | [DEPLOYMENT.md](./DEPLOYMENT.md) |\n| Comparison vs Firecrawl / Crawl4AI | [COMPARISON.md](./COMPARISON.md) |\n\n---\n\n## 💜 Sponsor DLBrowser\n\nDLBrowser is MIT and free forever, and we keep a **free hosted demo gateway** running for\neveryone. Sponsoring funds new backends, published benchmarks, site-specific scrapers, and\nkeeps the free tier free. If it saves your agents from getting blocked — or saves you\ntokens — please consider it.\n\n**[Become a sponsor →](https://github.com/sponsors/shivam27cool)** · tiers from $10/mo to\n$1,000/mo. Full perks in [SPONSORS.md](./SPONSORS.md).\n**$25/mo and up puts your name (or logo, at $100+) in the banner below** — seen by everyone\nwho visits the repo, the PyPI page, and the npm page.\n\n### Our sponsors\n<!-- sponsors:start -->\n<p align=\"center\">\n  <em>Be the first — your name or logo here.</em><br>\n  <a href=\"https://github.com/sponsors/shivam27cool\"><strong>Become a sponsor →</strong></a>\n</p>\n<!-- sponsors:end -->\n\n---\n\n<div align=\"center\">\n\n**Give your agent the whole web.**\n\n```bash\nnpx dlbrowser connect --key dlb_xxx\n```\n\nBuilt by [Dekrypt Labs](https://dekryptlabs.com) · MIT License · `sales@dekryptlabs.com`\n\n</div>\n\n---\n\nmcp-name: io.github.DekryptLabs/dlbrowser\n",
  "bytes": 11165,
  "sha": "1c9f03debf38f45ed6a1947c91c4d80da45b3cd2c7ced6353ff11affeea23e93",
  "repo_slug": "dekryptlabs/dlbrowser",
  "fonte": "repo",
  "truncated": false,
  "api": "https://agentalog.com/api/listings/mcp_io_github_dekryptlabs_dlbrowser_3cd3d7d4/readme"
}