Problems installing esphome

sorry, don’t know about Raspbian as mine is OS X :wink:
the main idea is you create a virtual environment and inside it install and configure everything how you you need, it won’t affect your system and you don’t have to have any special permissions etc.

You say you have a spare pi to set up as a dev machine. So just install docker and follow Otto’s very good instructions.