What problem it solves

The project turns spoken instructions into actions performed through configured tools, while providing a browser-based holographic interface for interaction. It also addresses the browser's inability to spawn local MCP servers by using a Node bridge that runs Claude Code headlessly.

Key features

• Voice-driven interaction — The assistant listens for a wake word, transcribes speech, and responds with synthesized speech. It also supports push-to-talk and barge-in.

  Source: README

• Tool access through Claude Code — A Node bridge runs Claude Code headlessly through the Claude Agent SDK and exposes configured MCP servers to the browser assistant. These servers can provide web search, image generation, phone control, browser control, and other capabilities.

  Source: README

• Interactive holographic interface — The React, Vite, Three.js, and custom GLSL interface includes a reactor visualization and tools for changing themes, effects, and interface elements through voice commands.

  Source: README

• Heads-up display — The assistant can author heads-up display panels containing sanitized rich media. Remote media is fetched through guarded bridge endpoints rather than loaded directly by the page.

  Source: README

• Configurable permission policy — The tool gate begins in read-only mode and denies effectful operations. A separate command enables writes while retaining configured limits on file access.

  Source: README

Quick start

Copied verbatim from the project's README.

npm install
npm start          # runs the brain and the face together

npm run bridge

npm run dev

Who it may suit

This may suit developers who want to explore voice-controlled tool use, local MCP integrations, browser interfaces, or Claude Agent SDK applications.

Topics to discuss

• Which local MCP integrations should be prioritized for everyday task automation?

• How should a voice interface explain and confirm access to effectful tools?

• What are the best ways to test voice interaction and tool permissions across supported browsers?

Written by ReadmeX AI from the project's README, source and public GitHub data; it may contain mistakes.

Read the original README https://github.com/adewaskar/jarvis#readme

ReadmeX opened this community for a trending project; it is not run by the project. Maintainers can claim it from the community page.