{
  "markdown": "# Extentos MCP Server\n\n[![npm version](https://img.shields.io/npm/v/%40extentos%2Fmcp-server)](https://www.npmjs.com/package/@extentos/mcp-server)\n[![license: MIT](https://img.shields.io/badge/license-MIT-blue.svg)](./LICENSE)\n\n**Give your AI coding agent the tools to build smart-glasses apps.**\n\nExtentos is an MCP (Model Context Protocol) server that lets agents like Claude Code, Cursor, and Cline add smart-glasses capabilities — camera capture, voice triggers, live transcription, audio playback — to any Android or iOS app. The tools are deterministic: discovery, scaffolding, validation, and a browser-based simulator for end-to-end testing without hardware.\n\nWorks with Meta smart glasses today (Ray-Ban Meta, Oakley Meta, Meta Ray-Ban Display), with a multi-vendor architecture by design.\n\nThis repository is the public home of [`@extentos/mcp-server`](https://www.npmjs.com/package/@extentos/mcp-server) — releases, changelog, and issue tracking. The package ships on npm.\n\n## Install\n\n**Claude Code**\n\n```bash\nclaude mcp add extentos -- npx -y @extentos/mcp-server@latest\n```\n\n**Cursor** — one click:\n\n[![Add to Cursor](https://cursor.com/deeplink/mcp-install-dark.svg)](cursor://anysphere.cursor-deeplink/mcp/install?name=extentos&config=eyJjb21tYW5kIjoibnB4IiwiYXJncyI6WyIteSIsIkBleHRlbnRvcy9tY3Atc2VydmVyQGxhdGVzdCJdfQ==)\n\n**Cline / any MCP client**\n\n```json\n{\n  \"mcpServers\": {\n    \"extentos\": {\n      \"command\": \"npx\",\n      \"args\": [\"-y\", \"@extentos/mcp-server@latest\"]\n    }\n  }\n}\n```\n\nRequires Node 20+.\n\n## What your agent can do with it\n\n| Tool group | What it does |\n|---|---|\n| **Discovery** | `getPlatformInfo`, `getCapabilityGuide`, `getCodeExample` — the SDK capability catalog, per-feature call shapes in Kotlin + Swift, and canonical end-to-end patterns (voice Q&A, photo-describe, live transcription UI, …) |\n| **Scaffolding** | `generateConnectionModule` — generates the connection UI + manifest + platform config for your app (Android or iOS) |\n| **Guidance** | `getVoiceCommandGuidance`, `getPermissions` — implementation guidance the agent queries instead of guessing |\n| **Validation** | `inspectIntegration`, `validateIntegration` — deterministic checks of the integration in your repo |\n| **Simulation** | `createSimulatorSession`, `getEventLog`, `getSimulatorStatus` — a browser simulator running the same SDK code as production with only the transport swapped; the agent drives it and reads the event log to verify behavior |\n| **Production** | `getProductionChecklist`, `getCredentialGuide` — the path from simulator to real glasses |\n| **Docs** | `searchDocs` — bundled, versioned documentation topics |\n\nThe workflow an agent typically runs: discover capabilities → scaffold the connection module → write handler code against the SDK → validate → simulate end-to-end → production checklist.\n\n## Tools\n\n- **getPlatformInfo** — SDK capability catalog, version/artifact info, and platform constraints\n- **getCapabilityGuide** — per-feature call shapes in Kotlin + Swift with gotchas\n- **getCodeExample** — canonical end-to-end patterns (voice Q&A, photo-describe, live transcription UI, …)\n- **getMigrationGuide** — mapping table and cutover plan from Meta DAT direct usage to Extentos\n- **generateConnectionModule** — scaffold the connection UI, manifest, and platform config into your app\n- **getConnectionPageConfig** — read the managed connection-page configuration\n- **setConnectionPageConfig** — update the managed connection-page configuration\n- **regenerateConnectionPageFile** — regenerate a managed connection-page file after config changes\n- **adoptConnectionPageFile** — bring an existing connection-page file under managed configuration\n- **getAssistantConfig** — read the managed voice-assistant configuration (model, voice, memory, wake sound)\n- **setAssistantConfig** — update the managed voice-assistant configuration\n- **listProjectSounds** — list custom sounds uploaded for the project\n- **addProjectSound** — upload a custom sound (earcons, wake sounds) to the project\n- **shutter** — trigger a camera shutter in the active simulator session\n- **getGatewayUsage** — AI-gateway usage and metering for the project\n- **getCredentialStatus** — which credentials (Meta DAT, AI provider) are configured\n- **setCredential** — store a credential for the project\n- **getProjectAnalytics** — usage analytics for the project's glasses integration\n- **getVoiceCommandGuidance** — implementation guidance for voice triggers and wake phrases\n- **getPermissions** — the exact permission set the integration needs per platform\n- **inspectIntegration** — read the current state of the integration in your repo\n- **validateIntegration** — deterministic checks of the integration (manifest, config, wiring)\n- **createSimulatorSession** — mint a browser-simulator session for end-to-end testing\n- **ensureSimulatorBrowser** — open/attach the simulator browser tab for the session\n- **completeAuthLink** — finish the device-code sign-in flow\n- **getEventLog** — read the session event log (transport, audio, camera, speak, toggle, stream, system)\n- **injectTranscript** — inject a voice transcript into the running app, as if the wearer spoke\n- **injectAssistantUtterance** — drive the voice assistant with an utterance end-to-end (real provider session)\n- **assertToolCalled** — wait for an assistant tool-call event matching name/args (agent E2E loop)\n- **getSimulatorStatus** — live session state: phase, roles, open streams, freshness, test videos\n- **setSimVideo** — pipe a test video into the simulated camera\n- **setSimDevice** — switch the simulated glasses model\n- **getDisplayState** — read the rendered display tree and interactive element ids (Ray-Ban Display)\n- **injectInput** — drive display input: select/navigate/back, like Neural Band gestures\n- **injectHardwareButton** — simulate the hardware capture button\n- **getProductionChecklist** — the path from simulator to real glasses\n- **getCredentialGuide** — how to obtain and configure Meta DAT credentials\n- **searchDocs** — search the bundled, versioned documentation topics\n\n## How it fits together\n\n- Your app depends on the native SDK: [`com.extentos:glasses`](https://central.sonatype.com/artifact/com.extentos/glasses) (Android, Maven Central) or the Swift package (iOS)\n- Your code subscribes to capability primitives from its own handler classes — `glasses.audio.transcriptions()`, `glasses.camera.capturePhoto()`, `glasses.audio.speak()`\n- The simulator is the same app on a different substrate: WebSocket transport instead of Bluetooth, so agent-verified behavior carries to hardware\n\nDiscovery, validation, and guidance tools work anonymously. Creating browser-simulator sessions and scaffolding require a free account — the server walks the agent (and you) through a device-code sign-in when needed.\n\n## Community integrations\n\nIndependent projects that have built with and evaluated Extentos:\n\n- **[EgoFlow](https://github.com/ego-flow/ego-flow-app/tree/extentos)** — an egocentric-video capture platform. Its `extentos` branch drives the glasses connection and live video through the Extentos Android SDK into EgoFlow's existing RTMP transport and backend, and was taken end-to-end on real Ray-Ban Meta glasses.\n- **[Voice-triggered capture POC](https://github.com/gggaswint/extentos-poc)** — an independent, MIT-licensed iOS proof of concept. A registered wake phrase triggers `glasses.camera.capturePhoto`, driven headlessly through the browser simulator by the MCP tools; the repo has the implementation and a recording of the run.\n\n## Links\n\n- [Documentation](https://extentos.com/docs)\n- [Getting started with an agent](https://extentos.com/docs/getting-started/with-agent)\n- [MCP tools reference](https://extentos.com/docs/reference/mcp-tools)\n- [The smart-glasses ecosystem reference](https://extentos.com/docs/ecosystem)\n\n## Issues & feedback\n\nBug reports and feedback are welcome — [open an issue](https://github.com/extentos/mcp-server/issues). The package is pre-1.0; tool surfaces may evolve between minor versions.\n\nFor security reports, see [SECURITY.md](./SECURITY.md) — please don't open public issues for vulnerabilities.\n\n## License\n\n[MIT](./LICENSE)\n",
  "bytes": 8190,
  "sha": "189c56e0b6ccc44091ff8907286706a006a97206c5afaf73c4e069e92ba4b194",
  "repo_slug": "extentos/mcp-server",
  "fonte": "repo",
  "truncated": false,
  "api": "https://agentalog.com/api/listings/mcp_com_extentos_mcp_server_482764a5/readme"
}