My understanding is that hardware currently available is up to the task - the limitation is that the Digital Signal Processing software magic is pretty much all currently proprietary.
Seeed have demos of using the multiple mics on their reSpeaker products - but their demos are not open source and their device driver uses only one mic. Espressif’s software for the ESP-S3 BOX is really impressive - but only works with their IDE, uses several key proprietary modules, and doesn’t do more than their demo. To be fair, neither of these companies is trying to sell product direct to public - they are selling the building blocks for other companies to use in their own products. And these other companies are (quite reasonably) wanting to get the most advantage from their own software investment … which means locking customers in to cloud servers
Agreed that no FOSS project can subsidise the hardware.
BUT it seems to me that we are currently spending about twice as much (for ESP-S3 BOX, RasPi + Jabra conference speaker, RasPi + reSpeaker, etc) as the for-profit mass-produced devices, and getting lower quality - most of which is the lack of DSP. I believe that with better firmware/software that price difference can be justified.
Mike has hinted several times throughout the year that Nabu Casa do see voice satellites as a key component of Home Assistant, and are closely watching developments in that area. In Chapter 5 we see that Nabu Casa have put in effort to bring the ESP-32-S3 BOX 3 from ESP-IDE to ESPHome. I understand that the ESP32-S3 chip includes some specialised AI hardware which could potentially be used to improve sound quality, wakeword detection, and some of the other DSP magic. I don’t care if some parts of it are proprietary and source code is not available (like RasPi video) - more important that it works reliably, independently, and LOCALLY.
The ESP S3 BOX 3 with ESPHome seems pretty close to my ideal voice satellite … and yet it was developed to showcase ESP’s hardware, not to sell direct to public as a finished product. Once the software is more mature, I anticipate Nabu Casa could leverage its ESP expertise to tweak the hardware and market a Voice Assistant Satellite, in much the same way that Home Assistant Blue, Yellow and Green are not totally new products developed from the ground up. Did “these small-batch, niche devices” “lose the interest of most people” and loose money for Nabu Casa ?
Just my thoughts. Nabu Casa will make its own decisions based on its own business intelligence and other factors. For the present time, with Nabu Casa support I am happy to recommend ESP-S3 BOX 3 running ESPHome as preferred voice satellite, with M5 ATOM Echo as an option to have lots of cheap “ears” around the house.