Automations or Blueprints for individuals with special needs or disabilities

Share your Projects! Custom Integrations
,
1

This is my first post, but I have been a user of Home Assistant for well over 10 years. Like many, I started small to tinker around primarily because I could see the future benefits it would have for my son. I have a disabled son who is now 16, he is non verbal and has limited mobility. He uses a wheel chair to get around, so my goal was to try to find ways to help him interact with his environment. So when we started building a new house in 2018. I went all in, dove in deep. I currently run Hasos on a PI5 with a NVMe SSD. I tried running it on multiple systems and environments, docker, UTM VM, VMWare, Proxmox, etc.. Ironically, I found that I preferred Hasos running separate on its on platform, which is why I settled for the PI5 with the NVMe SSD currently. I may go back to proxmox vm, it was also working well. I have pi-hole, Ollama, scrypted, and frigate all running nicely and playing well together. I am by no means a programer or a master at having Hasos sing my praises, but I am an engineer, so I enjoy the challenge of learning and solving new problems.

I decided that I would spend the next several months making things work specifically for my son’s needs. He uses an speech device that I discovered has the ability to ad icons that fire webhook actions, so I created him a few action buttons on his device to controls his, lights, fan, etc.. I also have an action button on his device the fires a webhook to notify/announce on a smart speaker in the house that he needs help and send my wife an I a notification to our phone.

Here is the reason for my topic. I am hoping that some of you in the community have similar needs, or have some ideas to help inspire my next pursuits with his automatons. I would like to have my cameras recognize where he is and notify us when we ask. Sure he is in a wheel chair, but he is 16 and does not like to sit still. The other ideas is that I would like to have his room and maybe the living room and kitchen react to things he needs. Maybe remind him to go to the bathroom, or do other chores, tasks to help improve his indepenence.

I think my ultimate goal would be to build a small Hasos installation, router and access point that is just for him that has pre-built functions that he could take with him to live in a special needs community. I have to recognize that he will not always be with me and there will be a day that he may need different care than what I can provide. So having something built for him that I could remotely manage would be awesome.

Again, I am going to take my time with this, but I am open to suggestions anyone may have.

2

To expand a bit, his speech device is an iPad running Lamp Words for Life. It works great to create simple webhook buttons that only fire locally and keeps him out of other stuff I don’t want him to control. I also don’t want to build him a custom kiosk or run it separately on his iPad. I can lock his screen on the single app.

Current struggle is I am having trouble getting the cameras to recognize him in his wheel chair. That is probably where I would start first so when a camera sees him it could fire certain events based on time of day, task, activity, etc.. He also wake up early, even before me. I am generally awake by 5:45, but occasionally he is wandering around the house until I get up. So it would be nice if the house recognized that and notify me and give him a task to do, like go to the bathroom, or watch you tube on his iPad, or even suggest he build something in his room with his blocks. Maybe even remind him to not go in the garage because he might set off the alarm.

I should point out that he can;t read, write, or type, but he does recognize pictures and understands spoken words and verbal directions. He can also chose an action based on a prompt if the image/choice is clear.