Automation: on Android app -> TTS -> open Assist -> use response as action?

[Nick4 (Nick)]

It’s just the last step that I cannot solve…
Searched, read a lot of topics but no luck.

1. TTS

action:
  - service: notify.mobile_app_<device>
    data:
      message: TTS
      data:
        tts_text: <message>

2. Open Assist

service: notify.mobile_app_<device>
data:
  message: command_activity
  data:
    intent_package_name: io.homeassistant.companion.android.(minimal)
    intent_action: android.intent.action.ASSIST

How do I pass on the answer, a ‘yes’ or ‘no’ to do something (or not)?

Thank you for putting me in the right direction!

[Notvans]

For the moment, Assist doesn’t support conversational context.

[will35]

Hello,

Look at this, first attempt with esp32 but work also with intent android assist

Automate listening by assist

It’s possible… For my first attempt, when the sun is below horizon, tts say " sun is below horizon, do you whant close the shutters ?" , I say " yes, i want" and it works. Add a switch in my ESP32 config to force listening without wakeword platform: template name: Listen id: Listen optimistic: true on_turn_on: - switch.turn_off: use_wake_word - delay: 1s - voice_assistant.start_continuous on_turn_off: - switch.turn_on: use_wake_word An automation “voice_close_shutter” , with "yes…

[Nick4 (Nick)]

From the topic you are referring to:

@will35

1: tts say "do you whant close the shutters "
2: automation.turn_on “voice_close_shutter”
3: turn_on Listen (the switch)
4: Wait 5 secondes (for response)
5: Turn_off Listen
6: automation.turn_off “voice_close_shutter”

Some steps would work, but for:
3: the equivalent for Android that I found is

service: notify.mobile_app_<device>
data:
  message: command_activity
  data:
    intent_package_name: io.homeassistant.companion.android.(minimal)
    intent_action: android.intent.action.ASSIST

Do you know any other way?
5: How to close the app?

How would you perform the action, that is: to translate a ‘yes’ answer to an action?

[Nick4 (Nick)]

What seems to work somehow:
In a script:

• TTS
• Delay 2s
• Trigger an automation

The automation (triggered with the ‘yes’ sentence)
action:

• Open Assist
• Delay 5s and say ‘yes’
• Call a service to do what is wanted

But… I get a response from Assist that it could not understand and the Assist app remains open.