Running an assist pipeline without TTS?

I’m trying to configure an assist pipeline with NO TTS functionality. I do not want the delays or extra processing of TTS because I do not plan to use it on the end devices, instead using an LED colour-based feedback system. Thus, I have disabled Piper and selected “None” as the TTS engine in my pipeline.

However, if I do so, and then try to use an ESPHome voice_assistant, I get the following error as soon as it starts:

homeassistant.components.assist_pipeline.pipeline.PipelineRunValidationError: the pipeline does not support text-to-speech

Is there any way around this?