It seems I misjudged how bad the internal esp32 antenna really is. Soldering antennas to each one helped immensely.
I hope this can help someone in the future.