View Assist - Visual feedback for Assist voice assistant on an Android tablet (Install info provided on Wiki)

Super exciting to hear this. My HA server is fine for handling the off device detection with streaming but on device would surely give a better experience.

Can’t wait to get my device in to start testing.

2 Likes

Another ThinkSmart View user trying to replicate my echo show devices, here. THE STUPID ADS. I DON’T WANT YOU TO DO ANYTHING BUT SHOW ME A CLOCK.

I digress. This project looks amazing and I can’t wait to implement it on my thinksmarts. It would be especially cool if it could be running in the background so that Fully Kiosk can be running a different app and still pop over to the assist screen to do the task, then go back to what it was doing.

2 Likes

I’ve updated the top message with the location of the start of the wiki. I want to remind everyone that I am far from a professional so any tips/guidance/corrections will go a long way to making this project better. Thanks again for the kind words!

2 Likes

Just added the pertinent portions of the configuration (just the voice and feedback, not the additional dashboards) to my thinksmart and it works great. Thanks again for the documentation and working out the configuration for this to all work well.

1 Like

Excellent. I appreciate the feedback and knowing what I put together worked. I hope to tidy things up and add the rest in the next few days. Let me know if you run into any issues. I tried my best to make the views responsive by using percentages but not sure how it will look on other devices.

My thinksmart shipped this afternoon and will certainly be my target device if I can manage to get the OS installed :slight_smile:

1 Like

I have three of these lenovo devices setup around my house doing on-device wake word detection, but they use a 3rd party app plugin that runs snowboy for the actual detection, not openwakeword. Despite the 3rd party plugin the experience is pretty fast and seamless, though I think your method has a few advantages, such as working on earlier versions of android, and being able to use openwakeword.

Here’s a video of one of mine in action:

See more here if you’re interested: Setting up a 100% local smart speaker on an Android tablet using Tasker and Snowboy to handle wake word detection

3 Likes

Thanks for sharing. Really cool stuff for sure. It won’t be long before everything comes together.

I’m really curious what’s going to happen when I have multiple devices listening for wake word. Right now with the Amazon devices I have an issue with the wrong one answering so seems like it isn’t listening at all. Maybe with these it will just have two listening and hopefully will respond back on the correct one or both.

1 Like

I’m excited to see how much easier the new ‘sections’ view type will eventually make creating these views. I struggle with the CSS positioning and sizing the most but once ‘sections’ matures we will really be in business!

2 Likes

I can help with CSS. That’s easy to me. :slight_smile:

But I can only help after the contest judging because I’m part of the Nabu Casa team. :sweat_smile:

2 Likes

While still needing a bit more content, the Wiki should contain enough information for someone to install everything needed for setting up the software side (thanks @ctjameson for confirming) and I’ve added the core automations, card views, and sample custom sentences to get things going. Please let me know if you find any errors and I will correct for you and other users who might be interested.

Congrats on winning the best voice experience, looking forward to seeing you present it on the podcast!

2 Likes

:partying_face: congrats indeed!

I knew this project was a winner!

1 Like

Thanks to you both. I’m hoping/planning to do the next demo on the Lenovo Thinksmart and wouldn’t have gotten as far as I am with it without y’all help.

3 Likes

The results of the contest are out!
They may be of interest to you :wink:
Have a look!

2 Likes

Continuing my convo from here: Is this the perfect standalone tablet for HA? - #751 by dinki

Interesting. It was detecting Browser Mod as a media player but now its saying unavailable. Is that what you ran into @dinki ? So, if i were to get back to A11, it sounds like i would have to flash stock firmware to clean up partitions and then follow your instructions?

1 Like

Yes that’s what I was seeing as well. Unfortunately this is not uncommon from my experience with BM. You can test the A8 to make sure it’s not working by opening the unavailable media player, clicking browse media, and then try sending a media file you have or use text to speech. If I remember correctly, I could not get any sound out of A8. If you can, you may be able to use it.

As far as flashing A11, I don’t remember doing anything special but I did go from flashing A8 with Linux to flashing A11 with windows. Be warned though, A11 definitely caused me issues and still have some oddities.

Curious if this is related: Entities become "unavailable" after 5 minutes · Issue #145 · thomasloven/hass-browser_mod · GitHub have you gotten browser mod to consistently stay connected in A11? I have a squeezlite device connected to the same room my smart speaker is in so i was thinking about just pushing the audio feedback to that speaker instead of having to rely on browser_mod for the audio. I’d have to have a special automation that waits for streamassist and somehow pipe the voice response to that speaker instead of the lenovo. Think thats doable?

Browser mod is odd with the media player. I often see it unavailable on boot but even then I can still play audio through it. I think you should be able to change Stream Assist to point to your preferred media player.

Congratulations! you deserved the win! well done :+1:

2 Likes

Well done, congrats! :+1: :bowing_man:

1 Like