Voice Assistant PE Help

Configuration Voice Assistant
1

I am new to the voice assistant portion of home assistant and I could use some help in getting it to watch/pull up Roku Apps on a TV. I ordered a couple of them. One for me for testing and one for my mother in law. I have set up her house to help her with her day to day, Lights, Pill reminders, etc. She is loosing her vision and it can be hard for her to use her remote from time to time so I am trying to improve her media portion of her life. It would be nice for her to just say Hey Jarvis watch netflix and have it pull it up on the screen. I can get automations to work but I can’t get voice pe to recognize them. Any help would be appreciated.

alias: Watch Hulu
description: “”
triggers:

  • trigger: conversation
    command:
    • Watch Hulu
      conditions:
      actions:
  • action: media_player.turn_on
    metadata: {}
    data: {}
    target:
    entity_id:
    - media_player.samsung_7_series_75
    - media_player.roku_family_room
    - media_player.yamaha_receiver_family_room
  • delay:
    hours: 0
    minutes: 0
    seconds: 5
    milliseconds: 0
  • action: media_player.select_source
    metadata: {}
    data:
    source: Hulu
    target:
    entity_id: media_player.roku_family_room
    mode: single
2

Are you using standard assist or are you using an LLM.

Also please put your yaml inside of preformatted text blocks. (under the gear icon I the post editor) spacing matters in YAML and that’s the only way we can see your spacing.

3

I finally got it to work by using an intent_script.yaml and intents/en.yaml to call on a script. I am using local LLM (llama3.2) with “Prefer handling commands locally” enabled. Is there a better/easier way?

4

It helps me understand your setup.

Theres a lot you need to know. From how assist identifies what to trigger and how an LLM does it

A lot of it is here. Specially what you need to know about context if you want to be successful with an LLM Friday's Party: Creating a Private, Agentic AI using Voice Assistant tools

You need to learn how intent scripts work. Standard scripts the limits of each and how the description tells the llm what’s in each.

(read: you’re jumping in both feet in the hard stuff)

5

Thank you Nathan! I will dig deeper into it. Been a systems engineer for years but fairly green to HA voice as most of everything I have set up is based off of automations. Having someone that needs assistance in everyday living is getting me to flex my brain for ways to make everybodys life easier. The main issue we had before was her taking her pills. Now 3 times a day the lights around her house will go red and they won’t return to normal until she goes to the kitchen to take them. We have zigbee button right next to them that returns them to normal and it sends my wife and I an alert on our phone. This has been huge for us and she has improved her bloodwork for the first time since being able to keep on this regular schedule. Plus the stress of not having to ping her to see if she has taken them has really helped my wife. Now it is on to other ways to improve her life at home. Appreciate it!

6

It’s all about context can you describe your automation to the llm.

1 Like