"ReSpeaker Lite" - new Seeed Studio Voice Assistant Development Kit hardware combine ESP32 with XMOS XU316 DSP chip for advanced audio processing as a ESPHome-based Home Assistant Assist Satellite voice devkit

@muhlba91 I already have generic S3 board attached to it, working great. Will update repo once I’m done with enclosure for that.

2 Likes

Yup, working on it :slight_smile:

Many thanks!

Hi @ginandbacon, I’m trying to merge your early wakeword select: code at the top of this thread with the latest code from @formatBCE.

The code is below and it’s format’s code with your select function, and an addtion of a on_tts_end entry to turn LEDs off in HA ww mode.

What I’m finding is that on boot, microwakeword works fine (Alexa). I then swap to the HA WW and this works but, when I swap back to microwakeword if doesn’t work. The action of swapping to HA ww and back again seems to break microwakeword.

To debug it, i removed the enabling of the HA WW in the select function and just called micro_wake_word.stop and micro_wake_word.start. These 2 calls are enough to stop microwakeword from working but I can’t see why. The code below has my modified select function with just these 2 calls. Do you know what I’m doing wrong?

substitutions:
  voice_assist_idle_phase_id: "1"
  voice_assist_listening_phase_id: "2"
  voice_assist_thinking_phase_id: "3"
  voice_assist_replying_phase_id: "4"
  voice_assist_not_ready_phase_id: "10"
  voice_assist_error_phase_id: "11"
  voice_assist_muted_phase_id: "12"
esphome:
  name: respeaker-satellite
  friendly_name: respeaker-satellite
  min_version: 2024.9.0
  platformio_options:
    board_build.flash_mode: dio
  on_boot:
    priority: 600
    then:
      - script.execute: adjust_led
      - lambda: id(stop_word).disable();
      - delay: 30s
      - if:
          condition:
            lambda: return id(init_in_progress);
          then:
            - lambda: id(init_in_progress) = false;
            - script.execute: adjust_led
  on_shutdown:
    then:
      # Prevent loud noise on software restart
      - lambda: id(respeaker).mute_speaker();

esp32:
  board: esp32-s3-devkitc-1
  variant: esp32s3
  flash_size: 8MB
  framework:
    type: esp-idf
    version: recommended
    sdkconfig_options:
      CONFIG_ESP32S3_DEFAULT_CPU_FREQ_240: "y"
      CONFIG_ESP32S3_DATA_CACHE_64KB: "y"
      CONFIG_ESP32S3_DATA_CACHE_LINE_64B: "y"
      CONFIG_ESP32S3_INSTRUCTION_CACHE_32KB: "y"
      CONFIG_ESP32_S3_BOX_BOARD: "y"
      CONFIG_SPIRAM_ALLOW_STACK_EXTERNAL_MEMORY: "y"
      
      CONFIG_SPIRAM_TRY_ALLOCATE_WIFI_LWIP: "y"

      # Settings based on https://github.com/espressif/esp-adf/issues/297#issuecomment-783811702
      CONFIG_ESP32_WIFI_STATIC_RX_BUFFER_NUM: "16"
      CONFIG_ESP32_WIFI_DYNAMIC_RX_BUFFER_NUM: "512"
      CONFIG_ESP32_WIFI_STATIC_TX_BUFFER: "y"
      CONFIG_ESP32_WIFI_TX_BUFFER_TYPE: "0"
      CONFIG_ESP32_WIFI_STATIC_TX_BUFFER_NUM: "8"
      CONFIG_ESP32_WIFI_CACHE_TX_BUFFER_NUM: "32"
      CONFIG_ESP32_WIFI_AMPDU_TX_ENABLED: "y"
      CONFIG_ESP32_WIFI_TX_BA_WIN: "16"
      CONFIG_ESP32_WIFI_AMPDU_RX_ENABLED: "y"
      CONFIG_ESP32_WIFI_RX_BA_WIN: "32"
      CONFIG_LWIP_MAX_ACTIVE_TCP: "16"
      CONFIG_LWIP_MAX_LISTENING_TCP: "16"
      CONFIG_TCP_MAXRTX: "12"
      CONFIG_TCP_SYNMAXRTX: "6"
      CONFIG_TCP_MSS: "1436"
      CONFIG_TCP_MSL: "60000"
      CONFIG_TCP_SND_BUF_DEFAULT: "65535"
      CONFIG_TCP_WND_DEFAULT: "65535"  # Adjusted from linked settings to avoid compilation error
      CONFIG_TCP_RECVMBOX_SIZE: "512"
      CONFIG_TCP_QUEUE_OOSEQ: "y"
      CONFIG_TCP_OVERSIZE_MSS: "y"
      CONFIG_LWIP_WND_SCALE: "y"
      CONFIG_TCP_RCV_SCALE: "3"
      CONFIG_LWIP_TCPIP_RECVMBOX_SIZE: "512"

      CONFIG_BT_ALLOCATION_FROM_SPIRAM_FIRST: "y"
      CONFIG_BT_BLE_DYNAMIC_ENV_MEMORY: "y"

psram:
  mode: octal  # quad for N8R2 and octal for N16R8
  speed: 80MHz

external_components:
  - source:
      type: git
      url: https://github.com/esphome/voice-kit
      ref: dev
      #url: https://github.com/formatBCE/home-assistant-voice-pe
      #ref: format_bce
    components:
      - aic3204
      - audio_dac
      - media_player
      - micro_wake_word
      - microphone
      - nabu
      - nabu_microphone
      - voice_assistant
    refresh: 0s
  - source: github://pr#7605
    components: [ audio, i2s_audio, speaker]
    refresh: 0s
  - source:
      type: git
      url: https://github.com/formatBCE/Respeaker-Lite-ESPHome-integration
      ref: main
    components: [ respeaker_lite ]
    refresh: 0s

api:
  on_client_connected:
    - script.execute: adjust_led
  on_client_disconnected:
    - script.execute: adjust_led

ota:
  - platform: esphome
    id: ota_esphome
    password: !secret ota_password

logger:

wifi:
  on_connect:
    - script.execute: adjust_led
  on_disconnect:
    - script.execute: adjust_led
  ssid: !secret wifi_ssid
  password: !secret wifi_password
  

captive_portal:

i2c:
  - id: bus_a
    sda: GPIO5
    scl: GPIO6
    scan: true

respeaker_lite:
  id: respeaker
  i2c_id: bus_a
  reset_pin: GPIO2
  mute_state:
    internal: true
    id: mute_state
  firmware_version:
    icon: mdi:application-cog
    name: XMOS firmware version
    internal: false
    id: firmware_version

switch:
  # Hardware speaker mute
  - platform: template
    id: speaker_mute_switch
    internal: true
    optimistic: true
    turn_on_action:
      - lambda: id(respeaker).mute_speaker();
    turn_off_action:
      - lambda: id(respeaker).unmute_speaker();
  # stateless momentary mic mute switch
  - platform: gpio
    internal: true
    pin: 
      number: GPIO4 # D3
      inverted: true
    id: mute_toggle
    on_turn_on:
      - delay: 300ms
      - switch.turn_off: mute_toggle
  # stateful user facing mic mute switch
  - platform: template
    id: mic_mute_switch
    name: Mic mute
    icon: mdi:microphone-off
    lambda: |-
      if (id(mute_state).state) {
        return true;
      } else {
        return false;
      }
    on_turn_on:
      - if:
          condition:
            lambda: return !id(init_in_progress);
          then:
            - script.execute:
                id: play_sound
                priority: false
                sound_file: !lambda return id(mute_switch_on_sound);
    on_turn_off:
      - if:
          condition:
            lambda: return !id(init_in_progress);
          then:
            - script.execute:
                id: play_sound
                priority: false
                sound_file: !lambda return id(mute_switch_off_sound);
    turn_on_action:
      - switch.turn_on: mute_toggle
    turn_off_action:
      - switch.turn_on: mute_toggle
  # Wake Word Sound Switch.
  - platform: template
    id: wake_sound
    name: Wake sound
    icon: "mdi:bullhorn"
    entity_category: config
    optimistic: true
    restore_mode: RESTORE_DEFAULT_ON
  - platform: template
    id: timer_ringing
    optimistic: true
    internal: true
    restore_mode: ALWAYS_OFF
    on_turn_on:
      # Duck audio
      - nabu.set_ducking:
          decibel_reduction: 20
          duration: 0.0s
      # Ring timer
      - script.execute: ring_timer
      # Activate stop-word
      - lambda: id(stop_word).enable();
      # Refresh LED
      - script.execute: adjust_led
      # If 15 minutes have passed and the timer is still ringing, stop it.
      - delay: 15min
      - switch.turn_off: timer_ringing
    on_turn_off:
      # De-activate stop word
      - lambda: id(stop_word).disable();
      # Stop any current annoucement (ie: stop the timer ring mid playback)
      - if:
          condition:
            lambda: return id(nabu_media_player)->state == media_player::MediaPlayerState::MEDIA_PLAYER_STATE_ANNOUNCING;
          then:
            lambda: |-
              id(nabu_media_player)
                ->make_call()
                .set_command(media_player::MediaPlayerCommand::MEDIA_PLAYER_COMMAND_STOP)
                .set_announcement(true)
                .perform();
      # Set back ducking ratio to zero
      - nabu.set_ducking:
          decibel_reduction: 0
          duration: 1.0s
      # Refresh the LED ring
      - script.execute: adjust_led

button:
  - platform: safe_mode
    id: button_safe_mode
    name: Safe Mode Boot
  - platform: factory_reset
    id: factory_reset_btn
    name: Factory reset
  - platform: restart
    name: Restart
    id: but_rest

binary_sensor:
  - platform: gpio
    pin: 
      number: GPIO3 # D2
      inverted: true
    id: user_button
    name: "User button"
    on_multi_click:
      - timing:
          - ON for at most 1s
          - OFF for at least 0.25s
        then:
          - if:
              condition:
                lambda: return !id(init_in_progress);
              then:
                - if:
                    condition:
                      switch.is_on: timer_ringing
                    then:
                      - switch.turn_off: timer_ringing
                    else:
                      - if:
                          condition:
                            lambda: return id(nabu_media_player)->state == media_player::MediaPlayerState::MEDIA_PLAYER_STATE_ANNOUNCING;
                          then:
                            - lambda: |
                                id(nabu_media_player)
                                  ->make_call()
                                  .set_command(media_player::MediaPlayerCommand::MEDIA_PLAYER_COMMAND_STOP)
                                  .set_announcement(true)
                                  .perform();
                          else:
                            - if:
                                condition:
                                  voice_assistant.is_running:
                                then:
                                  - voice_assistant.stop:
                                else:
                                  - if:
                                      condition:
                                        media_player.is_playing:
                                      then:
                                        - media_player.pause:
                                      else:
                                        - if:
                                            condition:
                                              and:
                                                - switch.is_off: mic_mute_switch
                                                - not:
                                                    voice_assistant.is_running
                                            then:
                                              - voice_assistant.start:

light:
  - platform: esp32_rmt_led_strip
    id: led_ww
    rgb_order: GRB
    pin: GPIO1
    num_leds: 1
    rmt_channel: 0
    chipset: ws2812
    name: none
    disabled_by_default: true
    entity_category: config
    default_transition_length: 0s

    effects:
      - pulse:
          name: "Fast Pulse"
          transition_length: 100ms
          update_interval: 100ms
          min_brightness: 50%
          max_brightness: 100%
      - pulse:
          name: "Slow Pulse"
          transition_length: 250ms
          update_interval: 250ms
          min_brightness: 50%
          max_brightness: 100%

 # Audio and Voice Assistant Config  

i2s_audio:
  - id: i2s_output
    i2s_lrclk_pin: 
      number: GPIO7
      allow_other_uses: true
    i2s_bclk_pin:  
      number: GPIO8
      allow_other_uses: true
    i2s_mclk_pin:  
      number: GPIO9
      allow_other_uses: true

  - id: i2s_input
    i2s_lrclk_pin:  
      number: GPIO7
      allow_other_uses: true
    i2s_bclk_pin:  
      number: GPIO8
      allow_other_uses: true
    i2s_mclk_pin:  
      number: GPIO9
      allow_other_uses: true

audio_dac:
  - platform: aic3204

microphone:
  - platform: nabu_microphone
    i2s_din_pin: GPIO44
    adc_type: external
    pdm: false
    sample_rate: 16000
    bits_per_sample: 32bit
    i2s_mode: secondary
    i2s_audio_id: i2s_input
    channel_0:
      id: nabu_mic_mww
    channel_1:
      id: nabu_mic_va
      
speaker:
  - platform: i2s_audio
    sample_rate: 16000
    i2s_mode: secondary
    i2s_dout_pin: GPIO43
    bits_per_sample: 32bit
    i2s_audio_id: i2s_output
    dac_type: external
    channel: left

media_player:
  - platform: nabu
    id: nabu_media_player
    name: Media Player
    internal: false
    audio_dac:
    speaker:
    sample_rate: 16000
    volume_increment: 0.05
    volume_min: 0.2
    volume_max: 0.85
    on_announcement:
      - nabu.set_ducking:
          decibel_reduction: 20
          duration: 0.0s
    on_state:
      if:
        condition:
          and:
            - switch.is_off: timer_ringing
            - not:
                voice_assistant.is_running:
            - not:
                lambda: return id(nabu_media_player)->state == media_player::MediaPlayerState::MEDIA_PLAYER_STATE_ANNOUNCING;
        then:
          - nabu.set_ducking:
              decibel_reduction: 0
              duration: 1.0s
    files:
      - id: mute_switch_on_sound
        file: https://github.com/esphome/home-assistant-voice-pe/raw/dev/sounds/mute_switch_on.flac
      - id: mute_switch_off_sound
        file: https://github.com/esphome/home-assistant-voice-pe/raw/dev/sounds/mute_switch_off.flac
      - id: timer_finished_sound
        file: https://github.com/esphome/home-assistant-voice-pe/raw/dev/sounds/timer_finished.flac
      - id: wake_word_triggered_sound
        file: https://github.com/esphome/home-assistant-voice-pe/raw/dev/sounds/wake_word_triggered.flac


micro_wake_word:
  models:
    - model: alexa
    - model: https://github.com/kahrendt/microWakeWord/releases/download/stop/stop.json
      id: stop_word
      internal: true
  vad:
  microphone: nabu_mic_mww
  on_wake_word_detected:
    # If a timer is ringing: Stop it, do not start the voice assistant (We can stop timer from voice!)
    - if:
        condition:
          switch.is_on: timer_ringing
        then:
          - switch.turn_off: timer_ringing
        # Start voice assistant, stop current announcement.
        else:
          - if:
              condition:
                lambda: return id(nabu_media_player)->state == media_player::MediaPlayerState::MEDIA_PLAYER_STATE_ANNOUNCING;
              then:
                lambda: |-
                  id(nabu_media_player)
                    ->make_call()
                    .set_command(media_player::MediaPlayerCommand::MEDIA_PLAYER_COMMAND_STOP)
                    .set_announcement(true)
                    .perform();
              else:
                - if:
                    condition:
                      switch.is_on: wake_sound
                    then:
                      - script.execute:
                          id: play_sound
                          priority: true
                          sound_file: !lambda return id(wake_word_triggered_sound);
                      - delay: 300ms
                - voice_assistant.start:
                    wake_word: !lambda return wake_word;

voice_assistant:
  id: va
  microphone: nabu_mic_va
  media_player: nabu_media_player
  noise_suppression_level: 0
  auto_gain: 0dBFS
  volume_multiplier: 1
  on_client_connected:
    - if:
        condition:
          - lambda: return id(init_in_progress);
          - switch.is_on: mic_mute_switch
        then:
          - switch.turn_off: mic_mute_switch
    - lambda: id(init_in_progress) = false;
    - micro_wake_word.start:
    - lambda: id(voice_assistant_phase) = ${voice_assist_idle_phase_id};
    - script.execute: adjust_led
  on_client_disconnected:
    - voice_assistant.stop:
    - lambda: id(voice_assistant_phase) = ${voice_assist_not_ready_phase_id};
    - script.execute: adjust_led
  on_error:
    - if:
        condition:
          lambda: return !id(init_in_progress);
        then:
          - lambda: id(voice_assistant_phase) = ${voice_assist_error_phase_id};
          - script.execute: adjust_led
          - delay: 1s
          - lambda: id(voice_assistant_phase) = ${voice_assist_idle_phase_id};
          - script.execute: adjust_led
  on_start:
    - nabu.set_ducking:
        decibel_reduction: 20   # Number of dB quieter; higher implies more quiet, 0 implies full volume
        duration: 0.0s          # The duration of the transition (default is 0)
  on_listening:
    - lambda: id(voice_assistant_phase) = ${voice_assist_listening_phase_id};
    - script.execute: adjust_led
  on_stt_vad_end:
    - lambda: id(voice_assistant_phase) = ${voice_assist_thinking_phase_id};
    - script.execute: adjust_led
  on_tts_start:
    - lambda: id(voice_assistant_phase) = ${voice_assist_replying_phase_id};
    - script.execute: adjust_led
    - script.execute: activate_stop_word_if_tts_step_is_long
  on_tts_end:
    - logger.log: "#############TTS_End"
    - lambda: id(voice_assistant_phase) = ${voice_assist_idle_phase_id};
    - script.execute: adjust_led
  on_end:
    - wait_until:
        not:
          voice_assistant.is_running:
    - nabu.set_ducking:
        decibel_reduction: 0   # 0 dB means no reduction
        duration: 1.0s
    - lambda: id(voice_assistant_phase) = ${voice_assist_idle_phase_id};
    - script.execute: adjust_led
    - script.stop: activate_stop_word_if_tts_step_is_long
    - lambda: id(stop_word).disable();
  on_timer_finished:
    - switch.turn_on: timer_ringing


select:
  - platform: template
    entity_category: config
    name: Wake word engine location
    id: wake_word_engine_location
    optimistic: true
    restore_value: true
    options:
      - In Home Assistant
      - On device
    initial_option: On device
    on_value:
      - if:
          condition:
            lambda: return !id(init_in_progress);
          then:
            - wait_until:
                lambda: return id(voice_assistant_phase) == ${voice_assist_muted_phase_id} || id(voice_assistant_phase) == ${voice_assist_idle_phase_id};
            - if:
                condition:
                  lambda: return x == "In Home Assistant";
                then:
                  - micro_wake_word.stop
                  - logger.log: "################################### micro_wake_word.stop"
                  - delay: 30ms
                  - if:
                      condition:
                        switch.is_off: mic_mute_switch
                      then:
                        #- lambda: id(va).set_use_wake_word(true);
                        #- voice_assistant.start_continuous:
            - if:
                condition:
                  lambda: return x == "On device";
                then:
                  #- lambda: id(va).set_use_wake_word(false);
                  #- voice_assistant.stop
                  - delay: 30ms
                  - if:
                      condition:
                        switch.is_off: mic_mute_switch
                      then:
                        - micro_wake_word.start         
                        - logger.log: "##################################### micro_wake_word.start"



script:
  # Script executed when we want to play sounds on the device.
  - id: play_sound
    parameters:
      priority: bool
      sound_file: "media_player::MediaFile*"
    then:
      - lambda: |-
          if (priority) {
            id(nabu_media_player)
              ->make_call()
              .set_command(media_player::MediaPlayerCommand::MEDIA_PLAYER_COMMAND_STOP)
              .set_announcement(true)
              .perform();
          }
          if ( (id(nabu_media_player).state != media_player::MediaPlayerState::MEDIA_PLAYER_STATE_ANNOUNCING ) || priority) {
            id(nabu_media_player)
              ->make_call()
              .set_announcement(true)
              .set_local_media_file(sound_file)
              .perform();
          }
  # Script executed when the timer is ringing, to playback sounds.
  - id: ring_timer
    then:
      - while:
          condition:
            switch.is_on: timer_ringing
          then:
            - script.execute:
                id: play_sound
                priority: true
                sound_file: !lambda return id(timer_finished_sound);
            - wait_until:
                lambda: |-
                  return id(nabu_media_player)->state == media_player::MediaPlayerState::MEDIA_PLAYER_STATE_ANNOUNCING;
            - wait_until:
                not:
                  lambda: |-
                    return id(nabu_media_player)->state == media_player::MediaPlayerState::MEDIA_PLAYER_STATE_ANNOUNCING;
  # Script used activate the stop word if the TTS step is long.
  # Why is this wrapped on a script?
  #   Becasue we want to stop the sequence if the TTS step is faster than that.
  #   This allows us to prevent having the deactivation of the stop word before its own activation.
  - id: activate_stop_word_if_tts_step_is_long
    then:
      - delay: 2s
      - lambda: id(stop_word).enable();
  - id: adjust_led
    then:
      - if:
          condition:
            lambda: return !id(init_in_progress);
          then:
            - if: 
                condition:
                  switch.is_on: timer_ringing
                then:
                  - light.turn_on:
                      id: led_ww           
                      red: 0%
                      green: 100%
                      blue: 0%
                      brightness: 60%
                      effect: fast pulse 
                else:
                  - if:
                      condition:
                        wifi.connected:
                      then:
                        - if:
                            condition:
                              api.connected:
                            then:
                              - lambda: |
                                  switch(id(voice_assistant_phase)) {
                                    case ${voice_assist_listening_phase_id}:
                                      id(led_ww).turn_on()
                                        .set_brightness(0.6)
                                        .set_rgb(1.0, 0.2, 1.0)
                                        .set_effect("Slow Pulse")
                                        .perform();
                                      break;
                                    case ${voice_assist_thinking_phase_id}:
                                      id(led_ww).turn_on()
                                        .set_brightness(0.6)
                                        .set_rgb(1.0, 0.2, 1.0)
                                        .set_effect("Fast Pulse")
                                        .perform();
                                      break;
                                    case ${voice_assist_replying_phase_id}:
                                      id(led_ww).turn_on()
                                        .set_brightness(0.6)
                                        .set_rgb(0.2, 1.0, 1.0)
                                        .set_effect("Slow Pulse")
                                        .perform();
                                      break;
                                    case ${voice_assist_error_phase_id}:
                                      id(led_ww).turn_on()
                                        .set_brightness(0.6)
                                        .set_rgb(1.0, 1.0, 0.2)
                                        .set_effect("Fast Pulse")
                                        .perform();
                                      break;
                                    case ${voice_assist_muted_phase_id}:
                                      id(led_ww).turn_on()
                                        .set_brightness(0.3)
                                        .set_rgb(1.0, 0.0, 0.0)
                                        .perform();
                                      break;
                                    case ${voice_assist_not_ready_phase_id}:
                                      id(led_ww).turn_on()
                                        .set_brightness(0.3)
                                        .set_rgb(1.0, 1.0, 0.2)
                                        .perform();
                                        break;
                                    default:
                                      id(led_ww).turn_off()
                                        .perform();
                                  }
                            else:
                              - light.turn_on:
                                  id: led_ww           
                                  red: 100%
                                  green: 0%
                                  blue: 0%
                                  brightness: 40%
                                  effect: fast pulse 
                      else:
                        - light.turn_on:
                            id: led_ww           
                            red: 100%
                            green: 0%
                            blue: 0%
                            brightness: 40%
                            effect: slow pulse
          else:
            - light.turn_on:
                id: led_ww           
                red: 100%
                green: 100%
                blue: 0%
                brightness: 30%
                effect: slow pulse

globals:
  - id: init_in_progress
    type: bool
    restore_value: false
    initial_value: "true"
  - id: voice_assistant_phase
    type: int
    restore_value: false
    initial_value: ${voice_assist_not_ready_phase_id}

this is the logfile:

[14:36:52][C][template.switch:068]: Template Switch 'Mic mute'
[14:36:52][C][template.switch:070]:   Icon: 'mdi:microphone-off'
[14:36:52][C][template.switch:091]:   Restore Mode: always OFF
[14:36:52][C][template.switch:057]:   Optimistic: NO
[14:36:52][C][psram:020]: PSRAM:
[14:36:52][C][psram:021]:   Available: YES
[14:36:52][C][psram:024]:   Size: 8191 KB
[14:36:52][C][safe_mode.button:024]: Safe Mode Button 'Safe Mode Boot'
[14:36:52][C][safe_mode.button:024]:   Icon: 'mdi:restart-alert'
[14:36:52][D][switch:016]: 'Mic mute' Turning OFF.
[14:36:52][D][switch:012]: 'mute_toggle' Turning ON.
[14:36:52][D][switch:055]: 'mute_toggle': Sending state ON
[14:36:52][D][micro_wake_word:379]: Starting wake word detection
[14:36:52][D][light:036]: 'respeaker-satellite' Setting:
[14:36:52][D][light:047]:   State: OFF
[14:36:52][D][light:109]:   Effect: 'None'
[14:36:52][C][factory_reset.button:011]: Factory Reset Button 'Factory reset'
[14:36:52][C][factory_reset.button:011]:   Icon: 'mdi:restart-alert'
[14:36:52][D][esp-idf:000][microphone_task]: I (6573) I2S: DMA Malloc info, datalen=blocksize=1280, dma_buf_count=4

[14:36:52][C][restart.button:017]: Restart Button 'Restart'
[14:36:52][C][restart.button:017]:   Icon: 'mdi:restart'
[14:36:52][D][i2s_audio.microphone:377]: Starting I2S Audio Microphne
[14:36:52][D][i2s_audio.microphone:381]: Started I2S Audio Microphone
[14:36:52][D][micro_wake_word:418]: State changed from IDLE to DETECTING_WAKE_WORD
[14:36:52][C][aic3204:112]: AIC3204:
[14:36:52][C][aic3204:113]:   Address: 0x18
[14:36:52][C][captive_portal:089]: Captive Portal:
[14:36:52][C][mdns:116]: mDNS:
[14:36:52][C][mdns:117]:   Hostname: respeaker-satellite
[14:36:52][C][esphome.ota:073]: Over-The-Air updates:
[14:36:52][C][esphome.ota:074]:   Address: respeaker-satellite.local:3232
[14:36:52][C][esphome.ota:075]:   Version: 2
[14:36:52][C][esphome.ota:078]:   Password configured
[14:36:52][C][safe_mode:018]: Safe Mode:
[14:36:52][C][safe_mode:020]:   Boot considered successful after 60 seconds
[14:36:52][C][safe_mode:021]:   Invoke after 10 boot attempts
[14:36:52][C][safe_mode:023]:   Remain in safe mode for 300 seconds
[14:36:52][C][api:140]: API Server:
[14:36:53][C][api:141]:   Address: respeaker-satellite.local:6053
[14:36:53][C][api:145]:   Using noise encryption: NO
[14:36:53][C][micro_wake_word:072]: microWakeWord:
[14:36:53][C][micro_wake_word:073]:   models:
[14:36:53][C][micro_wake_word:015]:     - Wake Word: Alexa
[14:36:53][C][micro_wake_word:016]:       Probability cutoff: 0.90
[14:36:53][C][micro_wake_word:017]:       Sliding window size: 5
[14:36:53][C][micro_wake_word:015]:     - Wake Word: Stop
[14:36:53][C][micro_wake_word:016]:       Probability cutoff: 0.50
[14:36:53][C][micro_wake_word:017]:       Sliding window size: 5
[14:36:53][C][micro_wake_word:021]:     - VAD Model
[14:36:53][C][micro_wake_word:022]:       Probability cutoff: 0.50
[14:36:53][C][micro_wake_word:023]:       Sliding window size: 5
[14:36:53][D][switch:016]: 'mute_toggle' Turning OFF.
[14:36:53][D][switch:055]: 'mute_toggle': Sending state OFF
[14:36:53][I][respeaker_lite:076]: Mic mute state: 0
[14:36:53][D][binary_sensor:036]: 'mute_state': Sending state OFF
[14:36:53][D][switch:055]: 'Mic mute': Sending state OFF
[14:36:53][D][media_player:080]: 'Media Player' - Setting
[14:36:53][D][media_player:093]:  Announcement: yes
[14:36:53][D][ring_buffer:034]: Created ring buffer with size 48000
[14:36:53][D][ring_buffer:034]: Created ring buffer with size 48000
[14:36:53][D][ring_buffer:034]: Created ring buffer with size 65536
[14:36:53][D][ring_buffer:034]: Created ring buffer with size 65536
[14:36:53][D][nabu_media_player.pipeline:174]: Reading FLAC file type
[14:36:53][D][nabu_media_player.pipeline:186]: Decoded audio has 1 channels, 48000 Hz sample rate, and 16 bits per sample
[14:36:53][D][nabu_media_player.pipeline:208]: Converting the audio sample rate
[14:36:53][D][nabu_media_player.pipeline:211]: Converting mono channel audio to stereo channel audio
[14:36:53][D][ring_buffer:034][speaker_task]: Created ring buffer with size 16384
[14:36:53][D][esp-idf:000][speaker_task]: I (6960) I2S: DMA Malloc info, datalen=blocksize=2048, dma_buf_count=4

[14:36:53][D][i2s_audio.speaker:123]: Started Speaker
[14:36:55][D][esp-idf:000][speaker_task]: I (9481) I2S: DMA queue destroyed

[14:36:55][D][i2s_audio.speaker:130]: Stopping Speaker
[14:36:55][D][i2s_audio.speaker:136]: Stopped Speaker
[14:37:47][I][safe_mode:041]: Boot seems successful; resetting boot loop counter
[14:37:47][D][esp32.preferences:114]: Saving 1 preferences to flash...
[14:37:47][D][esp32.preferences:143]: Saving 1 preferences to flash: 0 cached, 1 written, 0 failed

>>>>selecting HA WW in GUI<<<<<<<<

[14:38:50][D][select:062]: 'Wake word engine location' - Setting
[14:38:50][D][select:115]: 'Wake word engine location' - Set selected option to: In Home Assistant
[14:38:50][D][select:015]: 'Wake word engine location': Sending state In Home Assistant (index 0)
[14:38:50][D][micro_wake_word:400]: Stopping wake word detection
[14:38:50][D][main:568]: ################################### micro_wake_word.stop

>>>>swapping back to on-board (microwakeword)<<<<

[14:39:37][D][select:062]: 'Wake word engine location' - Setting
[14:39:37][D][select:115]: 'Wake word engine location' - Set selected option to: On device
[14:39:37][D][select:015]: 'Wake word engine location': Sending state On device (index 1)
[14:39:37][W][micro_wake_word:375]: Wake word dection is already running
[14:39:37][D][main:587]: ##################################### micro_wake_word.start

XXXX wake word doesn't work from here onwards until a reboot XXXX

It states the wake word detection is already running. Is the start/stop not working somehow. Can you help?

OMG after days of getting a fail on updating the firmware to respeaker_lite_i2s_dfu_firmware_48k_v1.0.9.bin I figured out why it would stop at 97%

I had right clicked and save file as on all the firmware files. Didn’t realise I had to click on the link and use the download button to download the firmware. It gave no indication I wasn’t doing it right

Currently I think I only have 2 CPU and 2 GB allocated to my HASS on VM player. I have to stop all addons to compile ESPhome code for both Respeaker lite and the N16R8 ESP32 boards. What are you guys doing?

I hold ESPHome on separate Docker server, with i7. :slight_smile:

Thanks for sharing that! I have been doing the same thing.

Good to know. I opened A ticket on GitHub and was told in so many words it was the wrong place to ask. Perhaps the site owner was having a bad day . . .

How much RAM allocated to it though? I am on a Win11 i5 Machine. Also do you have to stop addons to compile the ESP code?

Docker LXC has 16 GB RAM. It’s Docker container (among ~30 others), so I don’t need to stop any add-ons. :slight_smile:

Oh ok. My Machine has 32GB but I assume the issue is the default config I went with when I followed the guides is the issue. Allocated 2GB RAM for Home assistant.

Yeah if you do that you must offload most add-ons to anywhere else…

meaning?

At the moment 2GB is allocated and i just increased it to 3GB

Just noticed my Esphome in the menu now says Esphome Device Compiler after the latest update

Well, many people are adding too much to HA, basically making it home lab/media server as well as automation hub. That often happens even on Raspberry Pi 4B. :slight_smile:

Anyways. Offtopic.

Tip! @tetele + laupalombi both submitted docs PRs on how-to get a better voice control experience:

PS: Please consider contributing to official HA documentation on home-assistant.io you too! :wink:

1 Like