Two-Way Audio (e.g. for doorbell, intercom, camera-systems, baby-monitors, sip, ...)

sparkydave · July 27, 2022, 12:04am

Pretty sure there are other FR’s for this same function but I’ve voted because I really want this.

pergola.fabio · July 27, 2022, 7:16am

Companion app already activates microphone, there was a PR about it a year ago, already included
I use it , because i’m using a lovelace SIP card, working great

crzynik · July 27, 2022, 12:59pm

On Android it does but not on iOS

pergola.fabio · July 27, 2022, 1:11pm

that i dont know, dont use iphone

Christoph_D · July 27, 2022, 10:16pm

Seems to be some work, but it would add nice features. It would even enable other possibilities, like leaving voice messages for other people in lovelace.

wmaker · July 27, 2022, 11:03pm

iPhone/iOS:
I have actually gotten 2-way SIP voice to work for iOS devices using Safari or Companion App (except I could not get to work for an old iPhone 6 which is running 12.5.5).

It is based on the following Lovelace SIP card:

I have made some modifications to the card, but from memory, the card should work as is for iOS.

dave_t_uk · July 28, 2022, 6:24am

A quick look at this suggests ‘RTSP backchannel’ might be a possible option.

pergola.fabio · July 28, 2022, 5:38pm

for the webrtc card, there is already someting brewing for rtsp backchannel, alex is working on it

conorlap · August 22, 2022, 4:02pm

@AlexxIT has created this for 2 way audio now, it would be amazing if we could have 2 way audio within Home Assistant dashboard cards:

AlexxIT · August 22, 2022, 4:52pm

Technically it’s very easy. I have an example, but don’t have time to write a card.

You need to init mic. The go2rtc will do the rest.

github.com

AlexxIT/go2rtc/blob/12b712426d9c872972da2283a55f524935e00f2f/www/webrtc.html#L95-L114

    
      
              if (stream) {
                  stream.getTracks().forEach(track => {
                      const sender = pc.addTrack(track, stream)
                      // track.stop();
                      // setTimeout(() => {
                      //     navigator.mediaDevices.getUserMedia({audio: true}).then(stream => {
                      //         stream.getTracks().forEach(track => {
                      //             sender.replaceTrack(track);
                      //         });
                      //     });
                      // }, 10000);
                  });
              }
          }
          
          
if (navigator.mediaDevices) {
              navigator.mediaDevices.getUserMedia({audio: true}).then(init).catch(() => init());
          } else {
              init();
          }

cemara · September 20, 2022, 2:46am

@AlexxIT Would it be possible to use this in conjuction with @myhomeiot 's dahua vto integration?
So that whenever the doorbell button is pressed, the 2 way video & audio would start immediately.
I suppose we wont need SIP server if we just want local access?

sygys · November 29, 2022, 7:13am

Home assistant is great but if there is one thing i learned in the last 3 years is that when you advance to the “next level” and really want to integrate everything to home assistant then allot is missing.

Asking difficult questions almost never getting the answers and in the end this results in hours and hours of figuring stuff out yourself. Its a fun process but i guess when things get complicated no one is willing to do the work. Making 2 way communication requires a rewrite of the android and ios app so that you can trigger a ring like notification when someone hits the doorbell and the app would open with a videostream and the mic is used to communicate. i dont think things like this are comming anytime soon.

And maybe there is a whacky way to open a card and do some strange things. but what you really want is the ha app opening to the camera stream and you can talk without setting up 100 more things when someone hits the doorbell.

I guess its allot easier to just install the ring app and do it that way… (no offense)

cicciuzzo · November 29, 2022, 8:13am

yeah but think when, for example, Dahua will suspend their app (sooner or later will happen). We will need a solution to have a private app to run our doorbell without any other 3rd party service. I agree that this will require time, but it will be an important step for this community.

djfanatix · December 1, 2022, 4:05pm

Will this also work with Doorbird?

I am looking for a solution to send a TTS message in case nobody is home

xtc0r · January 7, 2023, 7:18pm

Would love to have 2 way audio directly in HA

JoFie · January 14, 2023, 9:55am

Maybe this is our lucky year…
Just starting with build-in TTS support will already be great!

JoshK · January 30, 2023, 12:55am

I believe 2 way audio support in homekit works with a lot of doorbells using Scrypted so it is definitely possible, I’m about to test Scrypted on a unifi setup with a g4 doorbell, will confirm if this works.

russ-sentient · January 30, 2023, 10:01pm

I have also just fired up a Scrypted docker on my Unraid server. I can do 2-way audio to my Amcrest POV cameras through the Home app on iOS, but only from my WiFi (even though I am using a WireGuard remote access VPN on my router). So I am also curious how I can integrate this functionality into Home Assistant, and use that as my gateway for remote access.

I ordered an Amcrest AD410 doorbell camera today, my goal being to get away from the Nest ecosystem and the cloud API needed to use it in Home Assistant. (And I could pull the stream into Frigate)

If I discover anything I will post it here.

GaryOkie · February 3, 2023, 4:34pm

just an FYI - if your new AD410 has bright glare on the sides of the image at night, it is due to a recent manufacturing defect with the IR/lens housing. Amcrest just got in new stock that fixes this issue but Amazon may still be selling the defective ones.

Amcrest warranty RMA process should be able to guarantee getting a good one.

pergola.fabio · March 26, 2023, 5:53pm

Anyone using scrypted here? I have heard it’s possible to use two way audio on homekit, but I use google… anyone tested scrypted with Google home devices? Is it possible to use two way audio there?