Same problem here as well!
Have you enabled shared and/or dynamic memory on your hypervisor, that my cause the issue that there is less memory then the operating system thinks it is and when reaching the upper end of the memory it runs out of memory. Try disabling these memory feature in the hypervisor and report back. Helped my with my QNAP Virtualisation Station installation.