There’s a good logical breakdown of the various combinations of HA and LLM here:
And a list of built-in commands here:
But I doubt if you’ll make much headway with “anything more involved” - any LLM has to have exhaustive and explicit instructions before it can do anything useful. There are a couple of good discussion threads:
The alternative is to use custom sentences and intents - some examples here.