HA Yellow Zigbee2MQTT Ember

raadms · May 10, 2024, 10:27am

I have HA yellow and with 2MQTT with the below configuration

Zigbee2MQTT version
[1.37.1]
Coordinator type
EZSP v8

Coordinator revision
6.10.3.0 build 297

Frontend version
0.6.167

19.37.2

0.46.6

the issue is i was trying to update the driver from EZSP to Ember by editing the configuration to Ember and the MQTT is stooped working the the below error.

[2024-05-10 13:24:25] error: z2m: Exiting…
[2024-05-10 13:24:25] error: z2m: Error: NCP EZSP protocol version of 8 does not match Host version 13
at EmberAdapter.emberVersion (/app/node_modules/zigbee-herdsman/src/adapter/ember/adapter/emberAdapter.ts:1633:19)
at EmberAdapter.initEzsp (/app/node_modules/zigbee-herdsman/src/adapter/ember/adapter/emberAdapter.ts:784:9)
at EmberAdapter.start (/app/node_modules/zigbee-herdsman/src/adapter/ember/adapter/emberAdapter.ts:2642:24)
at Controller.start (/app/node_modules/zigbee-herdsman/src/controller/controller.ts:124:29)
at Zigbee.start (/app/lib/zigbee.ts:62:27)
at Controller.start (/app/lib/controller.ts:109:27)
at start (/app/index.js:107:5)

so I think that i have to update the zigbee firmware. if yes how can i?

Thank you.

francisp · May 10, 2024, 10:54am

Firmware is here:

AurelianRQ · May 27, 2024, 8:29am

I am trying to have same thing and it seems that i get similar error , could you please provide more details on what we need to do to have this working

Thanks

francisp · May 27, 2024, 9:03am

Click on raw to download the firmware

Then follow the instructions here

$ cd silabs-firmware
$ universal-silabs-flasher --device <serial-path> \
    flash --allow-cross-flashing --firmware <firmware-file>

AurelianRQ · May 27, 2024, 9:25am

Thanks, just did that, i tried the last stable as well the last beta , and i get this "

[12:16:53] INFO: Preparing to start...
[12:16:53] INFO: Socat not enabled
[12:16:55] INFO: Starting Zigbee2MQTT...
[2024-05-27 12:17:01] info: 	z2m: Logging to console, file (filename: log.log)
[2024-05-27 12:17:01] info: 	z2m: Starting Zigbee2MQTT version 1.37.1-dev (commit #9b3a394)
[2024-05-27 12:17:01] info: 	z2m: Starting zigbee-herdsman (0.49.0)
[2024-05-27 12:17:02] info: 	zh:ember: Using default stack config.
[2024-05-27 12:17:02] info: 	zh:ember: ======== Ember Adapter Starting ========
[2024-05-27 12:17:02] info: 	zh:ember:ezsp: ======== EZSP starting ========
[2024-05-27 12:17:02] info: 	zh:ember:uart:ash: ======== ASH NCP reset ========
[2024-05-27 12:17:02] info: 	zh:ember:uart:ash: RTS/CTS config is off, enabling software flow control.
[2024-05-27 12:17:02] info: 	zh:ember:uart:ash: Serial port opened
[2024-05-27 12:17:02] info: 	zh:ember:uart:ash: ======== ASH starting ========
[2024-05-27 12:17:03] info: 	zh:ember:uart:ash: ======== ASH connected ========
[2024-05-27 12:17:03] info: 	zh:ember:uart:ash: ======== ASH started ========
[2024-05-27 12:17:03] info: 	zh:ember:ezsp: ======== EZSP started ========
[2024-05-27 12:17:03] error: 	z2m: Error while starting zigbee-herdsman
[2024-05-27 12:17:03] error: 	z2m: Failed to start zigbee
[2024-05-27 12:17:03] error: 	z2m: Check https://www.zigbee2mqtt.io/guide/installation/20_zigbee2mqtt-fails-to-start.html for possible solutions
[2024-05-27 12:17:03] error: 	z2m: Exiting...
[2024-05-27 12:17:03] error: 	z2m: Error: NCP EZSP protocol version of 8 does not match Host version 13
    at EmberAdapter.emberVersion (/app/node_modules/zigbee-herdsman/src/adapter/ember/adapter/emberAdapter.ts:1674:19)
    at EmberAdapter.initEzsp (/app/node_modules/zigbee-herdsman/src/adapter/ember/adapter/emberAdapter.ts:854:9)
    at EmberAdapter.start (/app/node_modules/zigbee-herdsman/src/adapter/ember/adapter/emberAdapter.ts:2683:24)
    at Controller.start (/app/node_modules/zigbee-herdsman/src/controller/controller.ts:127:29)
    at Zigbee.start (/app/lib/zigbee.ts:62:27)
    at Controller.start (/app/lib/controller.ts:109:27)
    at start (/app/index.js:107:5)
[12:22:56] INFO: Preparing to start...
[12:22:57] INFO: Socat not enabled
[12:22:59] INFO: Starting Zigbee2MQTT...
[2024-05-27 12:23:05] info: 	z2m: Logging to console, file (filename: log.log)
[2024-05-27 12:23:05] info: 	z2m: Starting Zigbee2MQTT version 1.37.1-dev (commit #9b3a394)
[2024-05-27 12:23:05] info: 	z2m: Starting zigbee-herdsman (0.49.0)
[2024-05-27 12:23:06] info: 	zh:ember: Using default stack config.
[2024-05-27 12:23:06] info: 	zh:ember: ======== Ember Adapter Starting ========
[2024-05-27 12:23:06] info: 	zh:ember:ezsp: ======== EZSP starting ========
[2024-05-27 12:23:06] info: 	zh:ember:uart:ash: ======== ASH NCP reset ========
[2024-05-27 12:23:06] info: 	zh:ember:uart:ash: RTS/CTS config is off, enabling software flow control.
[2024-05-27 12:23:06] info: 	zh:ember:uart:ash: Serial port opened
[2024-05-27 12:23:06] info: 	zh:ember:uart:ash: ======== ASH starting ========
[2024-05-27 12:23:06] error: 	zh:ember:uart:ash: Received ERROR from NCP while connecting, with code=RESET_WATCHDOG.
[2024-05-27 12:23:06] error: 	zh:ember:uart:ash: ASH disconnected | NCP status: ASH_NCP_FATAL_ERROR
[2024-05-27 12:23:06] error: 	zh:ember:uart:ash: Error while parsing received frame, status=ASH_NCP_FATAL_ERROR.
[2024-05-27 12:23:06] info: 	zh:ember:uart:ash: ======== ASH NCP reset ========
[2024-05-27 12:23:06] info: 	zh:ember:uart:ash: ======== ASH starting ========
[2024-05-27 12:23:07] info: 	zh:ember:uart:ash: ======== ASH connected ========
[2024-05-27 12:23:07] info: 	zh:ember:uart:ash: ======== ASH started ========
[2024-05-27 12:23:07] info: 	zh:ember:ezsp: ======== EZSP started ========
[2024-05-27 12:23:07] warning: 	zh:ember: [EzspConfigId] Failed to SET "APS_UNICAST_MESSAGE_COUNT" TO "32" with status=ERROR_OUT_OF_MEMORY. Firmware value will be used instead.
[2024-05-27 12:23:07] info: 	zh:ember: [STACK STATUS] Network up.
[2024-05-27 12:23:07] error: 	z2m: Error while starting zigbee-herdsman
[2024-05-27 12:23:07] error: 	z2m: Failed to start zigbee
[2024-05-27 12:23:07] error: 	z2m: Check https://www.zigbee2mqtt.io/guide/installation/20_zigbee2mqtt-fails-to-start.html for possible solutions
[2024-05-27 12:23:07] error: 	z2m: Exiting...
[2024-05-27 12:23:07] error: 	z2m: Error: [BACKUP] Current backup file is from an unsupported EZSP version (min: 12).
    at EmberAdapter.getStoredBackup (/app/node_modules/zigbee-herdsman/src/adapter/ember/adapter/emberAdapter.ts:1363:23)
    at EmberAdapter.initTrustCenter (/app/node_modules/zigbee-herdsman/src/adapter/ember/adapter/emberAdapter.ts:1156:37)
    at EmberAdapter.initEzsp (/app/node_modules/zigbee-herdsman/src/adapter/ember/adapter/emberAdapter.ts:865:19)
    at EmberAdapter.start (/app/node_modules/zigbee-herdsman/src/adapter/ember/adapter/emberAdapter.ts:2683:24)
    at Controller.start (/app/node_modules/zigbee-herdsman/src/controller/controller.ts:127:29)
    at Zigbee.start (/app/lib/zigbee.ts:62:27)
    at Controller.start (/app/lib/controller.ts:109:27)
    at start (/app/index.js:107:5)

" any other ideas ? thanks a lot

And just to put it in the context , i am trying to have my Giex GX02 Water valve working with homeassistant as using tuya is a nightmare, i assume partially from the gateway they provide

AurelianRQ · May 28, 2024, 9:53am

I did tried as well 7.4.1 as in the yellow it does say that it works only with 7.4.0 and 7.4.1 but unfortunately same result, it does not want to work and i keep on getting Bad Gateway error in HA when i try to access the service , plus those errors in the log . Any ideas on how to have this working ? do i need to get another adapter ? maybe try to use the Sonoff E one as controller ?

SavanFlou · June 1, 2024, 12:13pm

Same here.
I tried with those lines

  $ cd silabs-firmware
$ universal-silabs-flasher --device /dev/ttyAMA1 \
    flash --allow-cross-flashing --firmware EmberZNet/beta/NabuCasa_Yellow_EZSP_v7.4.0.0_PA32_ncp-uart-hw_115200.gbl

But I cannot open Z2M interface on my Home Assistant.
Stange thing, I use HASS Agent, and it says it is connected to Z2M without a problem, an automation using HASS agent also worked like a charm.
So… I do not understand.

francisp · June 1, 2024, 12:25pm

Hass Agent uses MQTT, and so does Zigbee2MQTT. But connecting HASS Agent to Zigbee2MQTT ? Impossible, since HASS Agent is not a Zigbee device.

SavanFlou · June 1, 2024, 4:44pm

Sorry, you are right, I mixed up.
Tried with the not beta firmware, EmberZNet/NabuCasa_Yellow_EZSP_v6.10.3.0_PA32_ncp-uart-hw_115200.gbl

and the result is the same.

stehof2 · June 4, 2024, 11:30am

Hi,

I have a totally new setup, I’m using openHAB as home automation server but want to try out Home Assistant. So I also bought a Home Assistant Yellow, I was already familiar with Z2M so I wanted to use this add-on on HA as well.

But I got the same error as @AurelianRQ, whatever configuration I tried that is out there that “should work”, didn’t…

Now I got it working by flashing the Zigbee/Thread chip, but I didn’t use the manual flash method, I used this HA add-on:

Just make sure nothing else is using the chip at the moment (also disable the Thread integration), then in the SiLabs flasher add-on under configuration, use this YAML:

device: /dev/ttyAMA1
bootloader_baudrate: "115200"
flow_control: true
verbose: false
firmware_url: >-
  https://github.com/NabuCasa/silabs-firmware/raw/main/EmberZNet/beta/NabuCasa_Yellow_EZSP_v7.4.0.0_PA32_ncp-uart-hw_115200.gbl

Save and start the add-on, this will start the flashing process, look into the Log tab to check if there are no error’s and if the flashing is done:

[11:06:17] INFO: universal-silabs-flasher-up script exited with code 0
s6-rc: info: service universal-silabs-flasher successfully started
s6-rc: info: service legacy-services: starting
s6-rc: info: service legacy-services successfully started
s6-rc: info: service legacy-services: stopping

When done, stop the SiLabs flasher add-on and start Z2M with this YAML configuration:

data_path: /config/zigbee2mqtt
socat:
  enabled: false
  master: pty,raw,echo=0,link=/tmp/ttyZ2M,mode=777
  slave: tcp-listen:8485,keepalive,nodelay,reuseaddr,keepidle=1,keepintvl=1,keepcnt=5
  options: "-d -d"
  log: false
mqtt:
  base_topic: zigbee2mqtt
serial:
  port: /dev/ttyAMA1
  baudrate: 115200
  rtscts: false
  adapter: ember

This did the trick for me, hopefully it works for you guys as well

SavanFlou · June 4, 2024, 4:15pm

Thank you, there is some progress for me

[2024-06-04 18:04:38] error: zh:ember: Failed to reset and init NCP. Error: [BACKUP] Current backup file is from an unsupported EZSP version (min: 12).erZNet/beta/NabuCasa_Yellow_EZSP_v7.4.0.0_PA32_ncp-uart-hw_115200.gbl

So I “just” need to find the correct version.

I changed a bit your YAML configuration for Z2m, because I did not have the

mqtt:
base_topic: zigbee2mqtt

but the value of my server, user and password. If I copy paste your version, where are stored all those information?

stehof2 · June 4, 2024, 6:05pm

Nice, but then you aren’t using a HA Yellow, or with a USB dongle?

These value will come from /config/zigbee2mqtt/configuration.yaml (in my case)
It is stored like this:

mqtt:
  server: mqtt://core-mosquitto:1883
  user: xxxxxxxx
  password: xxxxxxxx

SavanFlou · June 4, 2024, 9:55pm

I do have a HA yellow. Maybe not the exact same chip inside? I bought mine beginning of this year.

I tried again to flash (and deactivate first MQTT, MQTT broker and Z2M to be sure) and I noticed some lines in the log of the silicon flasher

2024-06-04 22:30:39.874 core-silabs-flasher bellows.ezsp INFO NCP entered failed state. No application handler registered, ignoring…

and then in Z2M log

[2024-06-04 23:51:36] error: z2m: Error while starting zigbee-herdsman
[2024-06-04 23:51:36] error: z2m: Failed to start zigbee
[2024-06-04 23:51:36] error: z2m: Check Zigbee2MQTT fails to start | Zigbee2MQTT for possible solutions
[2024-06-04 23:51:36] error: z2m: Exiting…
[2024-06-04 23:51:36] error: z2m: Error: NCP EZSP protocol version of 8 does not match Host version 13

So I think there is a problem with the “NCP” and my yellow, so that blocks. I will have to look again… but tomorrow.

SavanFlou · June 14, 2024, 12:24pm

Cannot succeed with this problem… I cannot use all my Zigbee devices, so… all my devices which are not mobile phones or with HASS agent.

To complete, my Home Assistant Yellow is a Rev 1.3

francisp · June 14, 2024, 3:08pm

First start with

adapter ezsp

only change after starting with ezsp to

adapter: ember

SavanFlou · June 17, 2024, 1:29pm

It is already, that is one of the many things I do not understand.
From this tread Z2M with Home Assistant Yellow: [Error: NCP EZSP protocol version of 8 does not match Host version 13] · Issue #23053 · Koenkk/zigbee2mqtt · GitHub
They said to me I have to use a more recent firmware… I used one
https://github.com/darkxst/silabs-firmware-builder/raw/ember-nohw/firmware_builds/yellow/ncp-uart-hw-v7.4.3.0-yellow-115200.gbl
but my problem is still the same, with this non sens about the ezsp.

Hedda · June 18, 2024, 9:55am

See the discussion here and notes that should first upgrade to EmberZNet 7.3 firmware while still using ezsp adapter before upgrading to EmberZNet 7.4 and ember adapter:

Same information here:

Regardless, you should really post questions about Z2M in the Zigbee2MQTT community channels instead as problems with Zigbee2MQTT configuration does not have anything directly to do with Home Assistant:

The Zigbee forum here in Home Assistant forum is really meant for the ZHA integration and Zigbee devices, not every other third-party Zigbee gateways/hubs/bridges (which includes Zigbee2MQTT and deCONZ).

SavanFlou · August 21, 2024, 7:21am

To conclude, I was with the firmware 7.4, and the only I had to do was to try to launch Z2M with EZSP, then with Ember, and it is perfectly working now.