GoldenPipe
One command to validate, transform, and deduplicate — chain GoldenCheck + Flow + Match.
Open source Repository Open in the app JSON README (API)
About
One command to validate, transform, and deduplicate — chain GoldenCheck + Flow + Match.
Details
- Kind
- MCP servers
- Topic
- No topic detected
- Publisher
- benseverndev-oss
- Origin
- official
- Category
- ferramentas
- Transport
- http
- Version
- 1.5.0
- Last push
- 2026-05-01T14:10:26Z
- Repository state
- arquivado
- Language
- Python
- License
- MIT
- Added
- 2026-08-29 03:02:30
- Updated
- 2026-08-29 03:02:30
- Origin id
io.github.benseverndev-oss/goldenpipe
README
> **Moved.** This repo has moved into the [`benzsevern/goldenmatch`](https://github.com/benzsevern/goldenmatch) monorepo at `packages/python/goldenpipe/`. This repo is archived; new development happens in the monorepo.
<!-- mcp-name: io.github.benzsevern/goldenpipe -->
# GoldenPipe
**Golden Suite orchestrator** -- Check quality, fix issues, deduplicate records. One command.
Built by [Ben Severn](https://bensevern.dev).
[](https://pypi.org/project/goldenpipe/)
[](https://github.com/benzsevern/goldenpipe/actions/workflows/test.yml)
[](https://codecov.io/gh/benzsevern/goldenpipe)
[](https://pepy.tech/project/goldenpipe)
[](https://python.org)
[](LICENSE)
[](https://benzsevern.github.io/goldenpipe/)
[](https://github.com/benzsevern/dqbench)
[](https://colab.research.google.com/github/benzsevern/goldenpipe/blob/main/scripts/goldenpipe_demo.ipynb)
## What It Does
```
Raw Data
| GoldenCheck -- profile & discover quality issues
| GoldenFlow -- fix issues, standardize, reshape
| GoldenMatch -- deduplicate, match, create golden records
v
Golden Records
```
GoldenPipe orchestrates the full pipeline with adaptive logic:
- **Skips** transformation if no quality issues found
- **Routes** to privacy-preserving matching if sensitive fields detected
- **Reports** reasoning for every decision
## Install
```bash
pip install goldenpipe
```
## Quick Start
```python
import goldenpipe as gp
result = gp.run("customers.csv")
print(result.status) # "success"
print(result.check) # Quality findings
print(result.transform) # What was fixed
print(result.match) # Deduplicated clusters
print(result.reasoning) # Why each decision was made
```
## CLI
```bash
goldenpipe run customers.csv # Full pipeline
goldenpipe run customers.csv --verbose # Show reasoning
goldenpipe run customers.csv --skip-flow # Check + Match only
goldenpipe run customers.csv --strategy pprl # Force privacy mode
goldenpipe run customers.csv -o golden.csv # Save golden records
```
## Remote MCP Server
GoldenPipe is available as a hosted MCP server on [Smithery](https://smithery.ai/servers/benzsevern/goldenpipe) — connect from any MCP client without installing anything.
**Claude Desktop / Claude Code:**
```json
{
"mcpServers": {
"goldenpipe": {
"url": "https://goldenpipe-mcp-production.up.railway.app/mcp/"
}
}
}
```
**Local server:**
```bash
pip install goldenpipe[mcp]
goldenpipe mcp-serve
```
4 tools available: list pipeline stages, validate wiring, run full check-transform-match pipeline, explain configs.
## Part of the Golden Suite
| Tool | Purpose | Install |
|------|---------|---------|
| [GoldenCheck](https://github.com/benzsevern/goldencheck) | Validate & profile data quality | `pip install goldencheck` |
| [GoldenFlow](https://github.com/benzsevern/goldenflow) | Transform & standardize data | `pip install goldenflow` |
| [GoldenMatch](https://github.com/benzsevern/goldenmatch) | Deduplicate & match records | `pip install goldenmatch` |
| [GoldenPipe](https://github.com/benzsevern/goldenpipe) | Orchestrate the full pipeline | `pip install goldenpipe` |
## Author
[Ben Severn](https://bensevern.dev)
## License
MIT