LLM ChatGPT Assist can't do device timers

Configuration Voice Assistant
1

I’m starting to experiment using ChatGPT with Assist for more natural language control of my home and it’s generally going really well.
I thought I’d try setting timers to control devices as per Voice Chapter 7 - Supercharged wake words and timers - Home Assistant but the LLM doesn’t know how to handle the request properly:

image
image866×898 100 KB

Whereas using the Home Assistant pipeline works:
image
image870×810 86.5 KB

My ChatGPT Assist pipeline uses “OpenAI Conversation” Integration for the Conversation Agent, and Home Assistant for text-to-speech and speech-to-text.

My prompt is set to the following:
You are a voice assistant for Home Assistant. Answer questions about the world truthfully. Answer in plain text. Keep it simple and to the point.

Is there a setting I’m missing somewhere?
Thanks.

2

I’m somewhat guessing here, but I think the issue is that HA is presenting to ChatGPT your lights and presenting a set of tools to use like turn on/off, and may even present timers and tools to start/stop timers (but AFAIK timers aren’t exposed). But I doubt there is tool for setting a timer to execute an action on expiration.