Skip to main content
The Audio Assistant node sits between an Audio Track trigger and downstream nodes (STT, alerts, models). It normalizes all input to PCM S16LE int16 @ 16 kHz mono via the shared audio ingress layer—the same contract as the rest of the audio pipeline.

Pipeline position

Modalities

Only one modality is active per node instance.

Shared audio contract

Upstream Audio Track buffer presets control chunk size into the node: For SSG, prefer accumulating at least 1–4 s per analysis window (default analysis preset: Speech-To-Text 4 s).

Edge execution

Audio Assistant nodes are edge-only. Workflows compile to a wf_*.py worker module and sync to the device:
Typical chain:
Compile checks:
  • VA upstream Audio Track must use buffer preset Voice Assistant (32 ms).
  • SSG upstream Audio Track should use Speech-To-Text (4 s) (or custom ≥1 s).
The compiler emits a warning listing required Python extras when VA/SSG nodes are present.

Edge dependencies

The edge-ml-worker container image pre-installs zenoh, ml-vad, ml-aed, and ml-wakeword, and pre-downloads AST and OpenWakeWord weights for air-gapped use. SSG on bare-metal edges downloads MIT/ast-finetuned-audioset-10-10-0.4593 on first run (~340 MB) unless baked into the image.

Pages