← All work SYS-03

Echo Home

Whole-House Voice Agent & 7-Camera Vision

MODEL: MUSE-SPARK AGENT SESSIONAUDIO: 5-ROOM PIPEWIRE + KOKOROVISION: 7 CAMERAS · FRIGATE
Operational Problem

Cloud smart speakers ship house audio to third-party servers, answer from rigid command menus, and can't use your own cameras, files, or tools.

Engineered System

The house only carries sound. A custom "Echo" wake word (openWakeWord) and Whisper speech-to-text in each room feed one persistent Muse (Muse Spark) agent session that reasons with its own tools — shell, files, web search, house sensors — with no hardcoded menus. Kokoro text-to-speech answers on the speakers of the room you are in, picked per turn by loudest mic, Frigate person detection and three ESP32 Wi-Fi CSI presence nodes, so the conversation follows you from room to room. An owner voiceprint gate decides who may speak, and privacy and game modes switch by voice. Frigate watches seven cameras — five RTSP plus two custom ESP32 nodes at about 13 frames per second — on dual CPU detectors, recording to the home server. Live-proven end to end in October 2026.

Speech & Reasoning
openWakeWord -> Whisper -> Muse Spark agent session
Synthesis & Routing
Kokoro TTS · follow-me room vote (mic + Frigate + CSI)
Camera Network
7 cameras (5 RTSP + 2 ESP32 ~13fps) on Frigate
Access & Modes
owner voiceprint · privacy/game by voice
wake word"Echo"
rooms5
cameras7
a turn6–9s