Meta Agent Tools
PT

Back to the catalog

ActableSite AI Crawler Monitor

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

Open source Repository Open in the app JSON README (API)

About

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

Details

Kind
MCP servers
Topic
Web search, scraping & browser
Publisher
com.actablesite
Origin
official
Category
ferramentas
Transport
http
Version
1.4.1
Last push
2026-07-17T09:46:14Z
Repository state
ativo
Language
JavaScript
License
MIT
Added
2026-08-29 03:00:51
Updated
2026-08-29 03:00:51
Origin id
com.actablesite/readiness

README

# ActableSite MCP

A remote, read-only MCP server for public website evidence, AI crawler policy, and explicit Crawler Watch, report, and Practice Radar offer metadata.

## Tools

It exposes five tools over Streamable HTTP:

- `audit_public_website` checks public identity, offer evidence, action paths, discovery files, metadata, and structured data.
- `check_ai_crawler_policy` evaluates eight OpenAI, Anthropic, Perplexity, and Google crawler tokens.
- `get_crawler_watch_offer` returns the $9 monthly price, one-site scope, 15-minute cadence, confirmation rule, delivery, cancellation, and synthetic-check limitations. It cannot open checkout or purchase anything.
- `get_full_report_offer` returns explicit metadata for an optional $19 one-time report. It cannot open checkout or purchase anything.
- `get_practice_radar_offer` returns the current weekly-edition receipt, public sample, $39 monthly price, delivery, cancellation, and material NPI limitations. It cannot open checkout or purchase anything.

## Connect

Claude Code:

```bash
claude mcp add --transport http actablesite https://actablesite.com/mcp/
```

For another MCP client, add a remote server named `actablesite` with:

- URL: `https://actablesite.com/mcp/`
- Transport: Streamable HTTP
- Authentication: none

For clients that require a local stdio command, clone this repository and run the dependency-free bridge:

```bash
git clone https://github.com/unitedideas/actablesite-mcp.git
cd actablesite-mcp
npm run start:stdio
```

The bridge contains the visible MCP implementation source in [`src/stdio.mjs`](src/stdio.mjs). Distribution version `1.4.2` exposes the same five read-only tools and sends requests only to ActableSite's bounded public JSON APIs. It has no file, shell, browser, account, or write capability.

The same stdio process is available as a public, non-root container:

```bash
docker run --rm -i ghcr.io/unitedideas/actablesite-mcp:1.4.2
```

The hosted server implements MCP protocol version `2025-06-18` and is published in the official registry as [`com.actablesite/ai-crawler-robots-monitor`](https://registry.modelcontextprotocol.io/v0.1/servers?search=com.actablesite/ai-crawler-robots-monitor&version=latest) version `1.4.2`.

## Discovery metadata

Directory scanners can read either machine-readable discovery surface:

- [`/.well-known/mcp.json`](https://actablesite.com/.well-known/mcp.json) identifies the official registry name, repository, remote endpoint, transport, authentication mode, and tool names.
- [`/.well-known/mcp/server-card.json`](https://actablesite.com/.well-known/mcp/server-card.json) provides static tool descriptions and JSON input schemas for scanners that cannot complete a live MCP handshake.

Both files describe the same unauthenticated endpoint and five-tool inventory verified by this repository.

## Ongoing crawler monitoring

The MCP tools report current public evidence and do not create background jobs. [Crawler Watch](https://actablesite.com/crawler-watch) is the separate $9/month service for one public website: it checks crawler policy, synthetic homepage responses, `sitemap.xml`, and `llms.txt` every 15 minutes and emails after a changed state appears twice.

Its synthetic requests do not authenticate provider IP ranges or prove crawling, indexing, citation, ranking, or traffic.

## Safety contract

- Public HTTP and HTTPS websites only; private, local, loopback, and reserved network destinations are rejected.
- No browser control, file access, account access, write, or mutation tools.
- No authentication header or API key is requested.
- Tool calls are limited to 60 per caller per hour.
- All three offer tools are informational and require explicit user confirmation before any separate checkout or purchase action.
- Practice Radar records do not prove licensure, active operation, demand, or buying intent and must be verified before contact.
- Results do not guarantee crawling, indexing, citation, ranking, recommendation, traffic, legal compliance, or revenue.

## Verify the live server

Node.js 20 or newer is required.

```bash
npm test
npm run verify:live
```

The verifier initializes the live server, checks its protocol and version, and confirms the exact read-only tool inventory. It does not call an audit tool or create a funnel event.

## Repository scope

This repository contains a runnable stdio implementation, public registry manifest, connection contract, live verifier, and security policy for the hosted ActableSite MCP server. The production runtime is operated at `https://actablesite.com/mcp/`.

## License

MIT

More