Use some kind of follow up mode like Amazon Alexa

[visionintegrations]

Voice Assistant: Follow-Up Responses - Feature Requests - Home Assistant Community (home-assistant.io)