I am using HA in a Vm and frigate as a docker and have a similar problem to you and was going to try figure it out in the coming weeks.
I was going to try mounting a share in HA using something like the following post.
Link
I see you are using an unassigned device. This could create issues with having it available as a share. In my case I have my device mounted as a btrfs pool with only that share saving to the pool.
I might try the Linux host/guest folder option as well now that you have planted that idea.
On a side note I just installed a m2 (a+e) coral tpu in my dell 7060 sff wifi slot and it works perfectly. I also tested it with success in a dell 9020m.