Automation delay triggering on state of Matter device

I purchased a Matter switch because Matter uses local push, and thus doesn’t have to be polled, in an attempt to get rid of the polling delays with polled devices. Most of the time my automation triggering on the state of the device runs immediately on pushing the switch.
But sometimes there is a delay of over 10 seconds. Does anyone know what might be introducing this delay? I’m running Home Assistant and the Matter server in docker containers on a Raspberry Pi 5.

What does the logbook show? Mine shows all my matter devices going unavailable several times a day.