Yes it will only be useful if the microphone and speaker can be remote. No one wants to go to their server cupboard to yell at home assistant. However there are solutions for that, for example the (long) thread on rhasspy Rhasspy offline voice assistant toolkit has several contributors, one of whom has made a networked microphone/speaker software thing.
Sorry that is not a technical description. Try https://github.com/koenvervloesem/hermes-audio-server