I might be wrong, but for me it doesn’t sound like you are really familiar with Python and virtual environments.
Is there a specific reason to use HA in a virtual environment? I’d suggest switching to one of the other installation methods and save you some headache in the future, because in a year you’ll be doing the same thing and a year later again etc.
See here an excellent overview of the differwnt installation methods: