Weather forecast from OpenAI Conversation Agent

dthree · June 13, 2024, 9:34pm

Prior to the June release, I had created an automation that when called from Assistant, would send weather data to OpenAI and have it create a natural language forecast that would then be read aloud by TTS. It took many iterations before I got it working reliably. After the update, I can’t call automations with the OpenAI assist agent, so I am looking for a way to replicate this feature. As far as I can tell, it doesn’t have access to the weather.get_forecasts service so I can’t get it to tell me any forecast. The only way I think it would work is if I can call that service in the conversation agent instructions, but I couldn’t figure out how to do that. Is this possible some other way? I’ll post the automation YAML below so you get an idea of what I’m trying to do.

github.com

dthreee/HA/blob/42330483e5abf5f6102e38c65f4b3e1e507fcab3/AI_weather_automation.yaml

alias: AI Weather
description: ChatGPT reads weather report, based on timeframe in the conversation prompt
trigger:
  - platform: conversation
    command:
      - What is the weather {my_timeframe}
      - Tell me {my_timeframe} weather
      - What is {my_timeframe} weather
      - Weather {my_timeframe}
      - "{my_timeframe} weather"
condition: []
action:
  - if:
      - condition: or
        conditions:
          - condition: template
            value_template: "{{ 'today' in trigger.slots.my_timeframe }}"
          - condition: template
            value_template: "{{ 'watermelon' in trigger.slots.my_timeframe }}"
          - condition: template

This file has been truncated. show original

Wolfgeek · August 6, 2024, 11:23pm

I’m also trying to get weather information from OpenAI via voice assistant. Did you find a way to get this working?

dthree · August 14, 2024, 8:14pm

I do not have a solution to this yet, but with the recent changes, I might look into it again.

TheStigh · August 25, 2024, 10:46pm

Hi @dthree

This one actually works for me, though only if I use Home Assistant Cloud and not my Open AI as Voice Assistant. So clearly related to - as you said - OpenAI can’t read Automations / platform: conversation is not detected by OpenAI Conversation.