I am currently trying to achieve the same, connect rpi3 with JBL charge 3 speaker to use with Google Assistant.
I have enabled the Bluetooth device_tracker component and captured the Mac address.
This part looks promising except for the sudo part.
I will take a look into creating it into an addon (or fork the current Bluetooth addon).