I’ve kept the standard rocker switches for now. I’d say replacing them with touch panels is optional. Also, I have a few wall panels with things like rocker switch + fan control, or 3x rocker switches on one panel, and I don’t think there are drop-in replacements available for these.
I really only notice this issue when I watch the HA user interface and press the physical switch at the same time. The lights turn on/off instantly, but the virtual switch in the user interface is a bit delayed, or sometimes on then off then on again - within ~3 seconds. Or, when I press a light switch button on a tablet running Tileboard, the lights turn on/off instantly, but that virtual switch is not updating immediately.
I’d say, the family does not notice this. I am aiming for turning on/off most of my lights automatically anyway - or train the family to use Alexa voice control.
I have a few more Aeotec Nano switches here waiting to be installed. My biggest frustration with these switches was really only when I got them brand new from the supplier, and they weren’t working reliably at all - the update to the latest available firmware fixed that (bar that issue described above). I read somewhere that OpenZWave (which is embedded in HA) does not support multiple versions of features, i.e. in my case I believe OpenZWave was expecting certain feature/behaviour that the older firmware on my switches did not yet support.
Eventually I want all lights in the main living areas, garden and pool controllable, and bed rooms, laundry, garage just remain fully manual. In bedrooms I’m supplementing the main (manual) lights with Philips Hue and hopefully soon IKEA trådfri lights.