Skip to content
Shub3amPublic

About

Hey Dot is a fully local, voice-first desktop AI assistant. It stays on top of your desktop, listens for "Hey Dot", captures your screen, runs local vision-language inference, and speaks back a concise answer. No cloud APIs, no internet dependency, and no data leaving your machine.

Resources

Stars

1 star

Watchers

0 watching

Forks

Repository files navigation

Hey Dot

A local-first voice and screen assistant for your Mac. Ask about what is on your screen and get a spoken answer, with models that run on your machine by default.

Status: being rebuilt from a hackathon prototype into a full app. The original prototype is preserved at tag v0-hackathon.

Asking Hey Dot about the screen, then reopening a saved chat

Screenshots

The answers shown are examples.

Chat Chat, dark
Chat page with a streamed answer about a TypeScript error The same chat in dark appearance
History Documents Settings
History page listing saved chats with Open and Delete Documents page describing document answers Settings page with the Screen Recording shortcut
  • Chat: ask about your screen. Each answer says whether it stayed on this Mac and whether a screenshot went along.
  • History: turn saving on to search, reopen and delete past chats. They are stored encrypted on this Mac.
  • Documents and Settings: say what is coming, and keep the one setting that works today.

Planned for the first release

  • Push-to-talk and typed questions about your screen, answered in a chat panel and spoken aloud
  • Follow-up questions within a conversation
  • Local models downloaded on first run, or your own cloud API key, clearly labelled when data leaves your Mac
  • "Hey Dot" wake word, tools and MCP, document Q&A in later phases

Develop

Requirements: macOS 14 or later, Rust (via rustup; the pinned version installs itself), Node 26, pnpm 12.

pnpm -C app install
pnpm -C app tauri dev

See AGENTS.md for test and build commands.

License

Apache-2.0. See LICENSE.

About

Hey Dot is a fully local, voice-first desktop AI assistant. It stays on top of your desktop, listens for "Hey Dot", captures your screen, runs local vision-language inference, and speaks back a concise answer. No cloud APIs, no internet dependency, and no data leaving your machine.

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages