Home Assistant Yellow is setup and running, but orange "system health" LED remains on

I have setup my HA Yellow device but the orange “system health” LED is always on. It also stays on after setting it explicitly to off via System → Hardware → Configure → Configure Hardware Settings. The other two LEDs go off if explicitly set to OFF.

My system has a CM4 with onboard eMMC and I have an NVME SSD attached, which I have successfully set as the data drive.

I am expecting the orange LED to turn off after a successful installation as the documentation mentions. What could be keeping it on?

Finally, I also expect the orange LED to turn off if I explicitly set it to off. Is this issue related?