Home Assistant Community Add-on: Node-RED

I did the same with credential_secret but got the same issue as you describes. There is a heated thread about this pwned thing here

I have not tried this myself yet but the notifications can be stop with this automation