How to use custom intents with LLM

Hi, after updating to 2024.06 I tried new conversation agent with Gemini, and it works really well. I had some custom intents created previously like “time to sleep” which triggers script to turn off specific lights, set alarm and do some other stuff. After changing conversation agent to Google Generative AI I am no longer able to trigger my custom intents. It returns “Sorry I had a problem talking to Google… 500: Internal error” message
On the release notes page for 2024.06 it says that custom intents are possible.

This is part of my configuration.yaml