writing-evals
axiomhq/skills · skills.sh
Open source Repository Open in the app JSON README (API)
About
Skill publicada por axiomhq/skills no skills.sh. Instale com: npx skills add axiomhq/skills@writing-evals
Details
- Kind
- Agent skills
- Topic
- No topic detected
- Publisher
- axiomhq
- Origin
- skillssh
- Category
- ferramentas
- Stars
- 16
- Forks
- 1
- Open pull requests
- 2
- Last push
- 2026-07-14T08:52:21Z
- Repository state
- ativo
- Language
- Shell
- License
- MIT
- Added
- 2026-08-30 15:22:33
- Updated
- 2026-09-08 15:04:47
- Origin id
axiomhq/skills/writing-evals
README
# Axiom Skills Agent skills for working with [Axiom](https://axiom.co). Skills are folders of instructions, scripts, and resources that coding agents load dynamically to improve performance on specialized tasks. ## Available Skills | Skill | Description | | ---------------------------------------------- | ---------------------------------------------- | | [sre](skills/sre/) | Hypothesis-driven SRE investigation with Axiom | | [spl-to-apl](skills/spl-to-apl/) | Translate Splunk SPL queries to Axiom APL | | [building-dashboards](skills/building-dashboards/) | Design and build Axiom dashboards from intent, templates, Splunk migrations, and metrics/MPL chart payloads (works with [query-metrics](skills/query-metrics/)) | | [axiom-alerting](skills/axiom-alerting/) | Unified monitor + notifier management for Axiom alerting via the v2 API | | [controlling-costs](skills/controlling-costs/) | Analyze query patterns to find unused data and optimize Axiom costs | | [query-metrics](skills/query-metrics/) | Run metrics queries against Axiom MetricsDB and discover available metrics, tags, and values | | [metrics-chart](skills/metrics-chart/) | Render metrics query results (`application/vnd.metrics.v3+json`) as line charts; zero-dependency ASCII by default, optional gnuplot PNG/SVG/sixel (pairs with [query-metrics](skills/query-metrics/)) | | [writing-evals](skills/writing-evals/) | Scaffold evaluation suites for the Axiom AI SDK | ## Requirements - **jq** - JSON processor (`brew install jq` or `apt install jq`) - **curl** - HTTP client (usually pre-installed) - **bc** - Calculator, needed by controlling-costs (`brew install bc` or `apt install bc`) ## MCP Server `.mcp.json` configures the hosted [Axiom MCP Server](https://github.com/axiomhq/mcp) at `https://mcp.axiom.co/mcp` for agent clients that install plugins from a manifest. See the [MCP setup docs](https://axiom.co/docs/console/intelligence/mcp-server). ## Installation ```bash npx skills add axiomhq/skills ``` This installs all skills. Skills have dependencies on each other (e.g., `controlling-costs` depends on `sre` and `building-dashboards`), so installing all is recommended. After installing, run the setup script to configure Axiom access: ```bash ~/.config/agents/skills/sre/scripts/setup ``` ## Configuration Most skills require access to Axiom. Create `~/.axiom.toml` with your deployment(s): ```toml [deployments.prod] url = "https://api.axiom.co" token = "xaat-your-api-token" org_id = "your-org-id" [deployments.staging] url = "https://api.axiom.co" token = "xaat-your-staging-token" org_id = "your-staging-org-id" ``` **To get these values:** - **`org_id`** - The organization ID. Get it from Settings → Organization. - **`token`** - Use an advanced API token with minimal privileges. The deployment name (e.g., `prod`, `staging`) is passed to scripts: `scripts/axiom-query prod "..."` ## License MIT License - see [LICENSE](LICENSE)