Create a Photo via HASS and Analyze it via Automation / AI

Configuration
1

Hi,

I am looking for a solution that will allow me to take a photo on my iPhone via the HASS app and use AI to analyse that picture.

But I didn’t found way to make a photo or upload a photo via HASS Dashboard / App.

Tobias

2

I would inquire the need to include HA in the process you described.

  • Why not just have AI analyze the iPhone photo you took without HA in the mix?

  • Is HA capturing the photo?

3

I want to build it independent of the phone which is used.

My plan it to take a photo or upload a photo, analyze which product is on the picture (my be with some details like bet before date and so on), and add it to my Grocy via Grocy API.

4

Other may have different opinion, but I’d process AI’s evaluation of the photo prior to inclusion into HA.

There are a lot on unanswered variable in your scenario like what specific AI platform you want to use. In my opinion, HA is not currently equipped to handle the AI photo evaluation you are trying to achieve.

5

you can cretae an Script with AI Task and of course it’s possible to add media files to an AI request.
Thats not the problem, my problem is to create a photo and trigger the script/automation after image creation.

If there is not “take a photo” card or something else, I need to create an own webapp for that.

6

action: camera.snapshot is available for taking the photo, but a 3rd party app most likely required to add the mobile device as a generic cam.