How do I configure google_assistant with more then one "home"?

In the google home app you can configure more then one “Home” (a physical address) i.e. “Home”, “Work”, “Vacation Home”. You can then toggle between them in the home app. However, when I have more then one “Home” configured i can’t figure out how to tell HA how to target the desired “Home” so when my devices show up in the google home app they don’t have a home, or the room that i configured in HA.

Here is a sample of my google assistant config:

google_assistant:
  project_id: SA-00000
  service_account: !include SERVICE_ACCOUNT.JSON
  expose_by_default: false
  report_state: true
  secure_devices_pin: "1234"
  exposed_domains:
    - alarm_control_panel
    - switch
    - fan
    - light
    - lock
    - cover
    - media_player
    - climate
    - sensor
  entity_config:
    switch.front_hall:
      name: Front Hall Lamp
      expose: true
      aliases:
        - Front Hall Light
      room: Front Hall

so, with “Home” and “Work” set up when i sync devices in the google assistant they come in to the google home app without a home or room set up, so i have to go through every device in the google home app and add it to a home and room. Very tedious.

What i want to do is have some way to flag which “Home” this instance of HA should direct entities to. I only have one instance of HA, which runs at my house, i don’t have one running at work so really all my entities would be directed to my one house.

the issue is also discussed here:
https://community.home-assistant.io/t/google-assistant-room-not-working-in-google-home-app/186208
and here:
https://community.home-assistant.io/t/cloud-google-assistant-area-room-hints-not-working/107913

But, “delete the other home” is not really a reasonable solution

thanks for your help