Google cast timeout on Nest Hub

I successfully cast selected views to my Google Nest Hub. However, the cast seems to time out after several hours. I guess it is something on the google nest side and not something that happens within HA. However I have no way of knowing when it times out. Anyone who has solved this problem?