I wonder if this is overly ambitious but I am curious if there is a way to give sight to HomeAssistant to drive automation. I can think of a multitude of benefits to having this. For example, and what caused me to dwell on this, is that I have a static voice message from HA that reminds me to lower the umbrellas in the back yard if they are open in case there are high winds and also to prevent them from obscuring camera views. Since that need is a visual cue for me, it would be an interesting visual cue for HA as well - to look and see if it needs to let me know the umbrellas are up (yes I know I could do some ESP devices, but “seeing” is what I’m after).
I could take a still image of the umbrellas or even an object behind them and make decisions based on if that object was visible or not, but there are so many factors that would skew those results such as rain, snow, very bright or very dim days - just too many variables to compare images as the only means to accomplish this.
Does anything like this exist that could be made to work with HomeAssistant? I use SecuritySpy for my cameras, and it can do some cool stuff but not sure it can do this. I suspect I would need a 3rd party system analyzing the feed to know but I don’t know what that might be. Bear in mind that the umbrella scenario is just one of many uses, I’m not looking to solve the umbrella situation alone - for that I could come up with all sorts of things to solve for that issue.