Bticino C300X working on Homekit and via scrypted

slyoldfox · December 22, 2022, 6:38pm

Hi,

I want to let everyone know that I managed to connect to the Bticino C300X to received audio/video as well as open door controls (together with guys that modified the firmware on Telegram).

I will put together some resources below:

Modify the official firmware and flash it to your device:

As I focussed on researching the audio/video part (not the door openings), you can find my first research here:

Further research aimed at being able to actually make a SIP call with the device and see the video (via X11):

gist.github.com

https://gist.github.com/slyoldfox/822bc31447f800f074448055f5848169

c300-sip.md

# SIP communication between c300x and baresip

The following document will help to explain the different components that are used to setup
a two-way audio and video call to the intercom to hear/talk and view the external camera.

Thank you @R for being my monkey and test things a lot.

## Todo/Not working yet

* Receiving calls from the intercom seems broken on `baresip` 2.9.0 (although working on 0.5.10)

This file has been truncated. show original

Someone was working on a SIP plugin for scrypted, the discussion can be found on github:

github.com/koush/scrypted

New plugin for SIP video doorbell - concept question

opened 11:17AM - 13 Nov 22 UTC

closed 04:23PM - 28 Nov 22 UTC

nanosonde

Hi @koush, I am planning to develop a new plugin which connects to my SIP vid…eo doorbell. The SIP video doorbell exposes the video stream via RTSP without any audio. However, to get the two-way audio streams it is required to call the the doorbell via SIP. In the past I already had a [PoC](https://github.com/Sunoo/homebridge-camera-ffmpeg/pull/1253) running based on the homebridge-camera-ffmpeg plugin. Now I would like to move completely to scrypted and use it for my Homekit camera setup. I need some advice on the right concept for this plugin as I am not familiar with the internal scrypted concepts and architecture in general. What would I like to achieve? 1. Homekit: use the RTSP video stream without audio (so only one stream), but with prebuffering and HK Secure Video. Recording also without audio 2. Homekit: when starting the live-streaming in the app, the new plugin shall call the video doorbell and setup two-way audio streaming. Note: As a SIP video doorbell is likely to be also integrated in some other SIP environment, it is required that the SIP call does not last indefinitly so that other SIP PBX participants can call the camera as well if nobody picks up via Homekit. As you can see in my PoC above, I have used a direct SIP INVITE to get the SDP and just wait for the OK response with SDP from the video doorbell. This is also based on [kirm/sip.js](https://github.com/kirm/sip.js/) that was used by the ring plugin before the [SIP API was removed](https://github.com/dgreif/ring/commit/7aeae37e6e93b68747e14983cea9c0a9229faec6). It boils down to this: ```typescript this.sipRemoteRtpDescription = await this.sipCall?.invite({ audio: { port: sipIncomingAudioPort, rtcpPort: sipIncomingAudioRtcpPort, ssrc: sipAudioSSRC }}); ``` So it basically something similiar that you are using here: https://github.com/koush/scrypted/blob/72333348981cffd2431256c4b3f614543636790b/plugins/ring/src/main.ts#L206 What I see from your ring plugin is that you seem to create a local RTSP server on demand and push the video and audio streams to it: https://github.com/koush/scrypted/blob/72333348981cffd2431256c4b3f614543636790b/plugins/ring/src/main.ts#L240 https://github.com/koush/scrypted/blob/72333348981cffd2431256c4b3f614543636790b/plugins/ring/src/main.ts#L298 While I think that I roughly know how to handle two-way audio based on the ring plugin, I am unsure how to handlle the complete separate video stream of the doorbell. It is itself negotiated via RTSP (and not via SIP). So the SIP plugin would also have to act like a RTSP client and push the stream to the new local on-demand RTSP-server. What do you propose here?

I ported and modified the code to make this work with the Bticino C300X:
GitHub - slyoldfox/scrypted: Scrypted is a high performance home video integration and automation platform for HomeKit, Google Home, Alexa, and more. (plugins/bticino) directory

Since scrypted has a Homekit integration it was pretty easy to view/hear through the Homekit interface.
I didn’t get to the point to import it as a seperate camera in home assistant at this point, I am just fine how it is at the moment. But it’s detected as a Homekit Controller and I’m sure it would work.

Good luck with this extra information.

javi_fly · November 26, 2023, 10:46pm

If I flash my Bticino 300X13E with this firmware I lose the original functionality to work with the “door entry” app?

javi_fly · December 9, 2023, 11:22am

more info:

slyoldfox · December 13, 2023, 4:13pm

No you don’t

Mattes83 · January 18, 2024, 10:24am

Great work, thanks for your efforts!

I guess I got most of it working, but I am not sure about the settings for the camera in scrypted. Are those fields auo populated and i do not need to adjust them? I am especially curious about the “sip FROM: uri” field as it does not match the user I created on the intercom.

Nevertheless it seems to work.

javi_fly · January 26, 2024, 10:50pm

more info here: https://community.home-assistant.io/t/bticino-door-entry-for-classe300x13e