Back to the catalog

io.github.shulex-voc/smart-crawler

E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.

Open source Repository Open in the app JSON README (API)

About

E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.

Details

Kind
MCP servers
Topic
Social & content
Publisher
shulex-voc
Origin
official
Category
ferramentas
Transport
http
Version
0.2.1
Last push
2026-06-08T10:04:12Z
Repository state
ativo
Added
2026-08-29 04:01:24
Updated
2026-08-29 04:01:24
Origin id
io.github.shulex-voc/smart-crawler

README

# smart-crawler MCP

E-commerce competitor intelligence, VOC review sentiment, Amazon ASIN analysis,
Google Shopping landscape, on-demand URL scraping, and Reddit subreddit growth
playbooks — exposed to AI agents as a hosted [Model Context Protocol](https://modelcontextprotocol.io) server.

- **Endpoint:** `https://smartcrawler.io/mcp/` (streamable-http)
- **Auth:** `Authorization: Bearer sck_...` — generate a key in the smart-crawler console
- **Registry:** [`io.github.shulex-voc/smart-crawler`](https://registry.modelcontextprotocol.io)

> This repository hosts the public MCP manifest for the smart-crawler service.
> It is the discovery/connection entry point — the service itself is hosted.

## Connect

### Claude Code

```bash
export SMARTCRAWLER_API_KEY=sck_...
claude mcp add --scope user --transport http smart-crawler \
  https://smartcrawler.io/mcp/ \
  --header "Authorization: Bearer $SMARTCRAWLER_API_KEY"
```

`--scope user` makes the server visible in every project. Without it,
`claude mcp add` defaults to *local* scope (only the current directory), a common
"I added it but `/mcp` is empty" pitfall. Verify with `claude mcp list` or `/mcp`.

### Codex (`~/.codex/config.toml`)

```toml
[mcp_servers.smart-crawler]
url = "https://smartcrawler.io/mcp/"
bearer_token_env_var = "SMARTCRAWLER_API_KEY"
```

### Any MCP client

Point your client at `https://smartcrawler.io/mcp/` over streamable-http and send
your API key as a Bearer token. See [`mcp.json`](./mcp.json) for the full tool list
and [`server.json`](./server.json) for the registry manifest.

## Tools (highlights)

| Tool | What it does |
|------|--------------|
| `reddit_subreddit_playbook` | Full growth playbook for a subreddit's top contributors |
| `search_competitor_products` | Search competitor catalog by brand / country / keyword / price |
| `get_voc_reviews` | Consumer VOC reviews from Trustpilot / Reviews.io / Google Maps |
| `amazon_voc_report` | Amazon ASIN reviews + AI VOC analysis (pain points, listing tips) |
| `competitor_landscape` | Google Shopping merchant-share ranking for a keyword |
| `scrape_url` | One-URL scrape with short-lived agent memory |
| `query_warehouse` | Warehouse-first natural-language query (0 credits) |

Full list in [`mcp.json`](./mcp.json).

## License

MIT

More