Upgrade Home Assistant to 2023.4 on Raspberry OS failed on cryptography 40.1

Deploying cryptography==40.0.1 (dependency of 2023.4) fails on Raspberry OS

  error: failed to select a version for the requirement `chrono = "=0.4.24"`
  candidate versions found which didn't match: 0.4.23, 0.4.22, 0.4.21, ...
  location searched: crates.io index
  required by package `cryptography-rust v0.1.0 (/tmp/pip-install-tibuusa0/cryptography_5ee0933289fd40a9acd66e9deee0e6d3/src/rust)`

      =============================DEBUG ASSISTANCE=============================
      If you are seeing a compilation error please try the following steps to
      successfully install cryptography:
      1) Upgrade to the latest pip and try again. This will fix errors for most
         users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip
      2) Read https://cryptography.io/en/latest/installation/ for specific
         instructions for your platform.
      3) Check our frequently asked questions for more information:
         https://cryptography.io/en/latest/faq/
      4) Ensure you have a recent Rust toolchain installed:
         https://cryptography.io/en/latest/installation/#rust

      Python: 3.10.8
      platform: Linux-5.10.103-v7l+-armv7l-with-glibc2.31
      pip: n/a
      setuptools: 67.6.1
      setuptools_rust: 1.5.2
      rustc: 1.59.0
      =============================DEBUG ASSISTANCE=============================

  error: `cargo rustc --lib --message-format=json-render-diagnostics --manifest-path src/rust/Cargo.toml --release -v --features 'pyo3/extension-module pyo3/abi3-py36' -- --crate-type cdylib` failed with code 101
  [end of output]

Hi,
I removed rust from apt and installed it using
curl https://sh.rustup.rs -sSf | sh