You may have better luck trying the route you are taking and good luck but the driver for the hardware display itself doesn’t work under HAOS, but is designed to run on Raspbian and needs to be installed on the host itself. Mine works fine with HA, here is what I did - (HAOS on a VM on the RPI5 with Pironman 5).