I found solution so if somebody has same problem, you need to downgrade observer and HA will upgrade it automatically (or you can also upgrade it manually if needed) and fix token issue.
This is downgrade command relevant for 2023.06.00 observer version:
ha observer upgrade --version 2022.10.0