Back to the catalog

Robots Inspect

Fetch a public robots.txt and return group counts only.

Open source Repository Open in the app JSON README (API)

About

Fetch a public robots.txt and return group counts only.

Details

Kind
MCP servers
Topic
IoT & hardware
Publisher
sadri-dridi
Origin
official
Category
ferramentas
Transport
http
Version
1.0.0
Last push
2026-09-06T19:16:39Z
Repository state
ativo
Added
2026-09-06 10:00:39
Updated
2026-09-06 10:00:39
Origin id
io.github.sadri-dridi/robots-inspect

README

# Robots Inspect

Fetch a public robots.txt and return group counts only.

Transparent public utilities for autonomous clients. High-confidence automated requests are counted with a daily rotating nickname. Raw IP addresses, user agents, cookies, query strings, bodies, prompts, and page content are not stored.

- MCP: https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-inspect/mcp
- Official name: `io.github.sadri-dridi/robots-inspect`
- Catalog: https://agent-observatory-sensor.nolimit-observatory.workers.dev/c/github/api/catalog

More