{
  "markdown": "# FeedKit\n\n[![PyPI](https://img.shields.io/pypi/v/feedkit)](https://pypi.org/project/feedkit/)\n[![Python](https://img.shields.io/pypi/pyversions/feedkit)](https://pypi.org/project/feedkit/)\n[![License](https://img.shields.io/github/license/QuartzUnit/feedkit)](https://github.com/QuartzUnit/feedkit/blob/main/LICENSE)\n[![Tests](https://img.shields.io/badge/tests-34%20passed-brightgreen)]()\n\n> [한국어 문서](README.ko.md) · [llms.txt](llms.txt)\n\n> RSS/Atom feed collection with **444 curated, verified feeds**. CLI + Python API + MCP server.\n\n## Quick Start\n\n```bash\npip install feedkit\n\nfeedkit search cloudflare           # search the built-in catalog\nfeedkit subscribe-catalog -c technology   # subscribe to all 68 tech feeds\nfeedkit collect                     # fetch all subscriptions (async parallel)\nfeedkit find \"kubernetes\"           # full-text search collected articles\n```\n\n## Install\n\n```bash\npip install feedkit             # core (CLI + Python API)\npip install \"feedkit[mcp]\"      # + MCP server\npip install \"feedkit[all]\"      # + MCP + OPML import/export\n```\n\n**Requirements:** Python 3.11+\n\n## How It Works\n\n```mermaid\nflowchart LR\n    A[\"📋 Catalog\\n444 curated feeds\"] --> B[\"Subscribe\\nselect feeds\"]\n    B --> C[\"🔄 Collect\\nfetch new entries\"]\n    C --> D[\"📦 Store\\nSQLite database\"]\n    D --> E[\"🔍 Query\\nfilter & retrieve\"]\n```\n\n## CLI Reference\n\n### Catalog Commands\n\n#### `feedkit search [QUERY]`\n\nSearch the built-in catalog of 444 curated feeds.\n\n```bash\nfeedkit search aws                    # search by title or domain\nfeedkit search --category science     # filter by category\nfeedkit search --language ko          # filter by language\nfeedkit search -c finance -l en -n 50 # combine filters\nfeedkit search -j                     # JSON output (for piping)\n```\n\n| Option | Short | Default | Description |\n|--------|-------|---------|-------------|\n| `--category` | `-c` | | Filter by category |\n| `--language` | `-l` | | Filter by language code (`en`, `ko`, `ja`, `zh`) |\n| `--limit` | `-n` | 20 | Max results |\n| `--json-output` | `-j` | | Output as JSON |\n\n#### `feedkit categories`\n\nList all available catalog categories.\n\n```\n$ feedkit categories\n  academia\n  finance\n  pets\n  science\n  society\n  technology\n```\n\n#### `feedkit stats`\n\nShow catalog and local subscription statistics.\n\n```\n$ feedkit stats\nCatalog: 444 feeds\n  academia: 13\n  finance: 89\n  pets: 27\n  science: 128\n  society: 119\n  technology: 68\n\nLocal: 68 subscriptions, 1,247 articles\n```\n\n### Subscription Commands\n\n#### `feedkit subscribe <URL>`\n\nSubscribe to a single feed.\n\n```bash\nfeedkit subscribe https://blog.cloudflare.com/rss/\nfeedkit subscribe https://example.com/rss -c tech -t \"My Feed\"\n```\n\n| Option | Short | Description |\n|--------|-------|-------------|\n| `--category` | `-c` | Category label |\n| `--title` | `-t` | Display title override |\n\n#### `feedkit subscribe-catalog -c <CATEGORY>`\n\nSubscribe to all feeds in a catalog category at once.\n\n```bash\nfeedkit subscribe-catalog -c technology   # subscribe to all 68 tech feeds\nfeedkit subscribe-catalog -c science      # subscribe to all 128 science feeds\n```\n\n#### `feedkit unsubscribe <URL>`\n\nRemove a feed subscription and its collected articles.\n\n#### `feedkit list`\n\nList all current subscriptions with fetch counts and error counts.\n\n### Collection Commands\n\n#### `feedkit collect`\n\nFetch new articles from all subscribed feeds (async parallel).\n\n```bash\nfeedkit collect                    # collect all\nfeedkit collect -c technology      # collect only tech feeds\nfeedkit collect -n 50              # max 50 concurrent requests\n```\n\n| Option | Short | Default | Description |\n|--------|-------|---------|-------------|\n| `--category` | `-c` | | Only collect from this category |\n| `--concurrency` | `-n` | 20 | Max concurrent HTTP requests |\n\nOutput:\n```\nCollecting from 68 feeds...\n 67/68 feeds OK, 412 new articles, 8234ms\n```\n\n#### `feedkit latest`\n\nShow most recently collected articles.\n\n```bash\nfeedkit latest                # latest 20 articles\nfeedkit latest -n 50          # latest 50\nfeedkit latest -c finance     # latest from finance only\n```\n\n#### `feedkit find <QUERY>`\n\nFull-text search (SQLite FTS5) across all collected articles.\n\n```bash\nfeedkit find \"kubernetes deployment\"\nfeedkit find \"large language model\" -n 50\n```\n\n### OPML Commands\n\n#### `feedkit import-opml <PATH>`\n\nImport feeds from an OPML file (Feedly, Inoreader, NetNewsWire, etc.).\n\n```bash\nfeedkit import-opml subscriptions.opml\n```\n\n#### `feedkit export-opml <PATH>`\n\nExport current subscriptions to OPML.\n\n```bash\nfeedkit export-opml backup.opml\n```\n\n## Python API\n\n```python\nfrom feedkit import search_catalog, fetch_feed, get_catalog_stats, FeedStore\nfrom feedkit.core import collect\n\n# Search the built-in catalog\nfeeds = search_catalog(\"cloudflare\")\nfeeds = search_catalog(category=\"technology\", language=\"en\", limit=50)\n\n# Fetch a single feed (async)\nentries = await fetch_feed(\"https://blog.cloudflare.com/rss/\")\nfor entry in entries:\n    print(entry.title, entry.url, entry.published)\n\n# Subscribe and collect\nstore = FeedStore()                              # SQLite at ~/.feedkit/feedkit.db\nstore.subscribe(\"https://blog.cloudflare.com/rss/\", category=\"tech\")\nresult = await collect(store, concurrency=20)    # async parallel fetch\nprint(f\"{result.new_articles} new, {result.feeds_ok}/{result.feeds_total} OK\")\n\n# Search collected articles (FTS5)\narticles = store.search(\"kubernetes\", count=10)\n\n# Latest articles\narticles = store.get_latest(count=20, category=\"tech\")\n\n# Feed health\nhealth = store.get_health()                      # fetch/error counts per feed\n\n# Catalog stats\nstats = get_catalog_stats()                      # {total_feeds, categories, languages}\n\nstore.close()\n```\n\n### Key Classes\n\n| Class | Description |\n|-------|-------------|\n| `FeedStore` | SQLite-backed subscription + article store (`~/.feedkit/feedkit.db`) |\n| `FeedEntry` | Single entry from a fetched feed (title, url, summary, published, author) |\n| `CollectResult` | Bulk collection result (feeds_ok, feeds_error, new_articles, duration_ms) |\n| `CatalogFeed` | Entry from the built-in catalog (url, title, category, subcategory, language, domain) |\n\n## MCP Server\n\n```bash\npip install \"feedkit[mcp]\"\nfeedkit-mcp                    # starts stdio MCP server\n```\n\n### Configuration\n\nClaude Code (`~/.claude/settings.json`):\n```json\n{\n  \"mcpServers\": {\n    \"feedkit\": {\n      \"command\": \"feedkit-mcp\"\n    }\n  }\n}\n```\n\n### Tools Reference\n\n| # | Tool | Parameters | Description |\n|---|------|-----------|-------------|\n| 1 | `fetch_single_feed` | `url`, `count=10` | Fetch entries from any RSS/Atom URL (no subscription needed) |\n| 2 | `search_feed_catalog` | `query`, `category`, `language`, `count=20` | Search the built-in 444-feed catalog |\n| 3 | `catalog_stats` | | Get catalog statistics (total, by category, by language) |\n| 4 | `subscribe_feed` | `url`, `title`, `category` | Subscribe to a feed for ongoing collection |\n| 5 | `unsubscribe_feed` | `url` | Remove a subscription |\n| 6 | `list_subscriptions` | | List all subscriptions with status |\n| 7 | `collect_feeds` | `category` | Collect new articles from all subscriptions |\n| 8 | `search_articles` | `query`, `count=10` | Full-text search across collected articles |\n| 9 | `get_latest_articles` | `category`, `count=20` | Get most recently collected articles |\n\n### MCP Workflow Example\n\n```\nUser: \"What are the latest AI papers on arXiv?\"\n\n1. search_feed_catalog(query=\"arxiv\", category=\"science\")\n   → finds arXiv cs.AI, cs.LG, cs.CL feeds\n\n2. subscribe_feed(url=\"https://rss.arxiv.org/rss/cs.AI\")\n\n3. collect_feeds(category=\"science\")\n   → fetches new entries\n\n4. get_latest_articles(category=\"science\", count=10)\n   → returns latest papers\n```\n\n## Built-in Catalog\n\n444 verified feeds across 6 categories. All audited — hard paywalls (Bloomberg, FT, WSJ) and broken URLs removed.\n\n| Category | Feeds | Subcategories | Highlights |\n|----------|------:|---------------|-----------|\n| **technology** | 68 | ai_ml, developer, it_news, security, startup, ... | AWS, Cloudflare, Stripe, Netflix, HN, Go Blog, Rust Blog |\n| **science** | 128 | journal, preprint, news, government | Nature, Science, arXiv, bioRxiv, medRxiv, NASA, PLOS |\n| **society** | 119 | news_us, news_ko, news_uk, news_intl, factcheck, ... | BBC, NPR, NYT, NHK, JTBC, PolitiFact, Snopes |\n| **finance** | 89 | markets, central_bank, regulatory, crypto | Fed, BOE, BOJ, SEC, CNBC, CoinDesk, Yahoo Finance |\n| **pets** | 27 | veterinary, community, blog, health | AKC, PetMD, ASPCA, dvm360, r/dogs, r/cats |\n| **academia** | 13 | ai_ml, research, institution | Google AI, DeepMind, Stanford HAI, Hugging Face |\n\n**Languages:** English (381), Korean (47), Japanese (14), Chinese (2)\n\nFull feed list: [CATALOG.md](CATALOG.md)\n\n## Why FeedKit?\n\n| | [awesome-rss-feeds](https://github.com/plenaryapp/awesome-rss-feeds) (2.1K★) | [engineering-blogs](https://github.com/kilimchoi/engineering-blogs) (37.5K★) | **FeedKit** |\n|--|---|---|---|\n| Type | Markdown list | Markdown list | **Python package** |\n| Feeds | ~500 | ~600 | 444 |\n| Scope | General | Tech blogs only | Tech + Science + Finance + News + Factcheck |\n| Last update | 2021 (stale) | 2022 (stale) | **Active (daily collection)** |\n| Verified working | No | No | **Yes (778K+ articles collected)** |\n| Legal audit | No | No | **Yes (paywall/ToS feeds removed)** |\n| CLI | No | No | **Yes (12 commands)** |\n| Programmatic API | No | No | **Yes (async Python)** |\n| MCP server | No | No | **Yes (9 tools)** |\n| OPML | No | No | **Yes (import/export)** |\n| FTS search | No | No | **Yes (SQLite FTS5)** |\n\n## Disclaimer\n\nThis package distributes a catalog of **publicly available RSS feed URLs**, not the feed content itself. RSS is a syndication standard — publishing an RSS feed is an explicit invitation for readers to subscribe. FeedKit fetches feeds on the user's behalf and does not store or redistribute copyrighted content.\n\nFeeds behind hard paywalls (Bloomberg, FT, WSJ, Barron's) and feeds with aggressive terms of service have been removed from the catalog.\n\n## Used in\n\n- [newswatch](https://github.com/QuartzUnit/newswatch) — RSS news monitoring pipeline (feedkit → markgrab → embgrep → diffgrab)\n\n## License\n\n[MIT](LICENSE)\n\n<!-- mcp-name: io.github.QuartzUnit/feedkit -->\n\n\n---\n\n<sub>Part of the [QuartzUnit](https://github.com/QuartzUnit) ecosystem — composable Python libraries for data collection, extraction, search, and AI agent safety.</sub>\n",
  "bytes": 10500,
  "sha": "c4537d0300616a966ebb9b6ea9c72ad890ffccdb8775bc01476a1d9345790c94",
  "repo_slug": "quartzunit/feedkit",
  "fonte": "repo",
  "truncated": false,
  "api": "https://agentalog.com/api/listings/mcp_io_github_arknill_feedkit_26c7ca90/readme"
}