2-way Audio w/ Reolink PoE Doorbell

qonfusion90 · July 24, 2024, 10:50pm

Hi,

Please note that this is the first time for me posting on the HA community page and the second time on a Github like site. Excuse me if I’m not aware of any rules.

I just bought a Reolink doorbell. (PoE White version) with the latest firmware.
At first it did’nt work, however I did read your comments and checked if other may have the same issues.

I’ve found the following github thread: https://github.com/koush/scrypted/discussions/1115 and got it working again with the firmware posted there and the following code:

Firmware PoE Only!
Black
https://support-d.reolink.com/attachments/token/u6B3AlhKl9rc1S2Y141mNP5f7/?name=DB_566128M5MP_P.3308_2407041184.Reolink-Video-Doorbell-PoE.OV05A10.5MP.REOLINK.pak

White
https://support-d.reolink.com/attachments/token/yrcqfKLxZknYuMi9I5T37DIzH/?name=DB_566128M5MP_P_W.3308_2407041199.Reolink-Video-Doorbell-PoE-W.OV05A10.5MP.REOLINK.pak

Go2RTC config

streams:
  camera.reolink_doorbell:
    - "ffmpeg:https://192.168.0.0/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=admin&password=password#video=copy#audio=copy#audio=opus"
    - rtsp://admin:[email protected]:554/h264Preview_01_sub

Custom card

type: custom:webrtc-camera
streams:
  - url: camera.reolink_doorbell
    mode: webrtc
    media: video,audio,microphone

Please note as state above, when using the custom card, the mic is always on when the card is presented and auto reply messages over REST commands does not work with this FW, but using the HA intergration it still does.

Hope this can help any of you, currently having issues with the two way audio and latest fw. I’m sure this will also be of help for you that are using Frigate.

DMedina559 · August 8, 2024, 1:39pm

https://support-d.reolink.com/attachments/token/BWuMT3WnhbCUWlwmbGyBLC7cw/?name=Reolink-Video-Doorbell-WiFi.3308_2405271823.DB_566128M5MP_W.paks

Here’s a link support sent me for my black wifi v2 model that got 2 way audio working in Frigate if anyone wants it

DMedina559 · August 19, 2024, 4:11pm

Reolink released new firmware publicly with the two way audio and some other fixes

keithnet · August 19, 2024, 5:45pm

v3.0.0.3308_2407315183 fixed auto reply messages over REST commands for me.

Cytomax55 · August 19, 2024, 8:17pm

Could you paste a working frigate and hA card config please?
I keep seeing people mix between onvif HTTP, flv and rtsp

Thanks in advance

DMedina559 · August 20, 2024, 2:44pm

Only Onvif/RTSP support two way audio in go2rtc.

ONVIF is the standard and RTSP is the protocol. Http/FLV are the same stream and doesn’t support two way audio in go2rtc.

github.com/AlexxIT/go2rtc

Reolink Video Doorbell discussion

opened 05:00AM - 04 Apr 23 UTC

luisiam

camera

The latest FW 1859 enables 2-way audio via ONVIF profile T. I checked with Happy…timesoft ONVIF client and 2-way audio works. Is there any chance to get it working in go2rtc? Output from info page ``` { "producers": [ { "type": "RTSP active producer", "url": "rtsp://192.168.10.21//", "remote_addr": "192.168.10.21:554", "user_agent": "go2rtc/1.3.1", "medias": [ "video, recvonly, H.264 High 5.1", "audio, recvonly, MPEG4-GENERIC/16000" ], "receivers": [ "96 H264, bytes=129455539, senders=1", "97 MPEG4-GENERIC/16000, bytes=1984536, senders=1" ], "recv": 132603331 }, { "type": "RTSP passive producer", "url": "rtsp://localhost:8554/fb75e35d718d1e0379580b00d5fcc0e7", "remote_addr": "127.0.0.1:43364", "user_agent": "ffmpeg/go2rtc", "medias": [ "audio, recvonly, OPUS/48000/2" ], "receivers": [ "96 OPUS/48000/2, bytes=2800207, senders=1" ], "recv": 2949215 } ], "consumers": [ { "type": "RTSP passive consumer", "url": "rtsp://localhost:8554/doorbell_test?audio", "remote_addr": "127.0.0.1:43354", "user_agent": "go2rtc/ffmpeg", "medias": [ "audio, sendonly, ANY" ], "senders": [ "96 MPEG4-GENERIC/16000, bytes=1984536, receivers=1" ], "send": 2046072 }, { "type": "WebRTC/WebSocket async passive consumer", "remote_addr": "tcp4 prflx 192.168.10.183:65337 related :0", "user_agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/111.0.0.0 Safari/537.36 Edg/111.0.1661.62", "medias": [ "video, sendonly, VP8, RTX, VP9, H264, AV1, RED, ULPFEC, FLEXFEC-03", "audio, recvonly, OPUS/48000/2, RED/48000/2, G722/8000, PCMU/8000, PCMA/8000, CN/8000, TELEPHONE-EVENT/48000, TELEPHONE-EVENT/8000", "audio, sendonly, OPUS/48000/2, RED/48000/2, G722/8000, PCMU/8000, PCMA/8000, CN/8000, TELEPHONE-EVENT/48000, TELEPHONE-EVENT/8000" ], "receivers": [ "111 OPUS/48000/2, bytes=812126, senders=0" ], "senders": [ "96 H264, bytes=124447151, receivers=1", "96 OPUS/48000/2, bytes=2679873, receivers=1" ], "recv": 1054116, "send": 128596160 } ] } ```

When you see other using the flv stream they also have the RTSP sub stream for just the mic.

Frigate docs mentions this

DMedina559 · August 20, 2024, 2:50pm

This is the config that works for me
Frigate config:

cameras:
  front_door_camera:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/front_door_camera?video=copy&audio=aac
          input_args: preset-rtsp-restream-low-latency
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/front_door_camera_sub?video=copy&audio=aac
          input_args: preset-rtsp-restream-low-latency
          roles:
            - detect
            - audio

Go2RTC config:

go2rtc:
  streams:
    front_door_camera:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@192.168.86.11:554/Preview_01_main#backchannel=0
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@192.168.86.11:554/Preview_01_sub
      - ffmpeg:front_door_camera#audio=opus#hardware
    front_door_camera_sub:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@192.168.86.11:554/Preview_01_sub
      - ffmpeg:front_door_camera_sub#audio=opus#hardware
  webrtc:
    candidates:
         - 192.168.86.32:8555
         - stun:8555

Frigate card:


    type: custom:frigate-card
    cameras:
      - camera_entity: camera.front_door_camera
        live_provider: go2rtc
        go2rtc:
          modes:
            - webrtc
          stream: front_door_camera
    menu:
      buttons:
        microphone:
          enabled: true
          type: toggle

Trax · August 22, 2024, 2:57pm

Hi,

Are you experiencing any delay?

From my computer and the HA companion app, I’m noticing a 3-second delay when I speak into my microphone to my doorbell. The sound from my doorbell is good with no delay.

Do you have any idea how I can solve this?

Scorpion-HA · September 23, 2024, 9:50am

hey @qonfusion90 thanks a lot for the config, got it working with that! but the audio is only 1 way right? it doesnt take the audio from the HA-device so that you can speak with the guys in front of the door or am I doing something wrong?

qonfusion90 · September 23, 2024, 2:28pm

Using the config I’ve shared two way audio should work.
Please note that the Mic only works when the connection is secured using an SSL cert. for example using LetsEncrypt!

Scorpion-HA · September 23, 2024, 4:51pm

ah, thanks @qonfusion90 for that hint. is https only for the browser needed or also for the HA android app? I thought that maybe the app does not need https so I can test if it works in general

Scorpion-HA · October 4, 2024, 2:10pm

Hey all,
got now HomeAssistant on HTTPS and microfone works now via the browser but is HTTPS also needed so that the microfone works on the HA-App? i read somewhere that microfone in general does not work with the HA-App? did someone get it running on the App?

besides that my HA-App does not work anymore after switching to HTTPS

redonionking · October 9, 2024, 11:09am

I’ve managed to get a media_player entity working on my Reolink Wifi doorbell- details here in case anyone needs them:
https://community.home-assistant.io/t/go2rtc-send-audio-to-cam/587937/29?u=redonionking

Lev · October 14, 2024, 12:49am

Hi all,
Did you manage to do it via the app or browser? I am struggling to get the mic working via the app. My connection is HTTPS, but still doesn’t work.

seheiahs · October 14, 2024, 12:22pm

Hi @Lev,

Have you tried always using Preview_01_sub instead of Preview_01_main ?

I had the same problem and this solved it for me.

seheiahs · October 14, 2024, 12:30pm

Hi all,

I recently bought a Reolink Doorbell (firmware version : v3.3.3.3308) which I have juste integrated into frigate.

The 2 ways audio works with this configuration (a more experienced friend gave it to me):

mqtt:
  host: 192.168.1.193
  port: 1883
  user: mqtt
  password: password
  topic_prefix: frigate
  stats_interval: 60

##########################################################################
go2rtc:
  streams:
    reolink:
      - rtsp://admin:[email protected]:554/Preview_01_sub#backchannel=0
      - rtsp://admin:[email protected]:554/Preview_01_sub
      - ffmpeg:reolink#audio=opus#hardware
##########################################################################

cameras:
  reolink:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/reolink?video=copy&audio=copy&audio=opus
          input_args: preset-rtsp-restream-low-latency
          roles:
            - audio
version: 0.14

However, like some of you, I have a latency issue: when i speak, I hear myself back (and loud engouh to be disturbing) about 2 ou 3 seconds later.

I’ve tried to change the configuration but so far I haven’t found anything that corrects the problem.

Do you have any ideas?

CPU usage can be as high as 80%, could this be the problem ? My configuration for HA : MINIS FORUM PC - Celeron N4020 (up to 2.8 GHz) 4 Go DDR4 / 64 Go eMMC

Any help is welcome

Lev · October 14, 2024, 9:44pm

Hi @seheiahs ,
I am using the “Preview_01_sub”. And the strange thing is that I am able to use mic when using the iPad with HA app, but with Android tablet it doesn’t work.

seheiahs · October 15, 2024, 7:46am

Hi @Lev,
Indeed, it’s astonishing. For my part, I had this problem on my phone and my tablet.
Do you have the possibility to test on another more powerful Android tablet? Have you tested configuration file I posted (by adapting it to your context) ?

Gailahan · October 26, 2024, 4:44pm

I have weird issues as well. On a Windows 10 PC I don’t see the microphone or audio mute buttons at all on the Frigate Card, and it’s the same on a Samsung Galaxy S20 Android phone. However, on a Samsung Galaxy Tablet I do see the microphone and audio mute buttons, but the microphone button does not appear to work. I have my config and some pictures below. Anyone have any ideas?

##########################################################################

cameras:
  front_door_doorbell:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/front_door_doorbell?video=copy&audio=aac
          input_args: preset-rtsp-restream-low-latency
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/front_door_doorbell_sub?video=copy&audio=aac
          input_args: preset-rtsp-restream-low-latency
          roles:
            - detect
            - audio

##########################################################################

go2rtc:
  streams:
    front_door_doorbell:
      - rtsp://<username>:<password>@<ip address>:554/Preview_01_main#backchannel=0
      - ffmpeg:front_door_doorbell#audio=opus#hardware
    front_door_doorbell_sub:
      - rtsp://<username>:<password>@<ip address>:554/Preview_01_sub
      - ffmpeg:front_door_doorbell_sub#audio=opus#hardware
  webrtc:
    candidates:
      - <ip address>:8555
      - stun:8555
version: 0.14

Here is my Frigate Card Configuration:

type: custom:frigate-card
cameras:
  - camera_entity: camera.front_door_doorbell
    live_provider: go2rtc
    go2rtc:
      modes:
        - webrtc
menu:
  buttons:
    microphone:
      enabled: true
      alignment: matching
    timeline:
      enabled: false
    cameras:
      enabled: false
    frigate:
      enabled: false
    download:
      enabled: false
    media_player:
      enabled: false
    mute:
      enabled: true
      alignment: opposing
    camera_ui:
      enabled: false
  style: outside
  position: right
  button_size: 66
  alignment: right
live:
  controls:
    thumbnails:
      mode: none
  auto_mute: all
  preload: false
dimensions: {}
media_gallery:
  controls:
    thumbnails:
      size: 140
      show_favorite_control: false
      show_timeline_control: false
      show_download_control: false
    filter:
      mode: none

Frigate Card on Samsung Galaxy Tablet shows microphone and audio button:

Frigate Card on Samsung Galaxy Tablet with microphone button on:

DannyFreedhorn · December 17, 2024, 4:09pm

Anybody else having issues after Frigate Gate 6.0 update? I can’t get audio or the microphone to work anymore.