Friday's Party: Creating a Private, Agentic AI using Voice Assistant tools

That is 100% true.

I assume you want to get that into 2026.9 if possible. That will be fine.

We’ll see i have some decidedly not ‘Hospitality’ focused and core fix centricnstuff staged up already. If I get enough I’ll do a 2026.8.1. But either way beta for 2026.9.0 will be up ‘soon’ (not weeks but not days either. Probably sometime late next week. Will need long beta for one feature in particular… )

2026.9.0 ‘Steel Magnolias’
The town that movie was filmed in (because the author of the story and screenplay demanded it) was where I was a pro firefighter mumble-mumble years ago. When the movie crews moved out. Enterprising entrepreneurs moved in and bought all the homes the movie used and voila… Bed and Breakfast! Stay at Shelby’s house… Way less noisemakers…

I go back on occasion. The B&Bs are still there and are quite good. I’d advise if you want a quiet getaways and are a historical buff.. But

We can think about the B&B from the perspective of the innkeeper. What do they have to do to keep things in order and what would THIER assistant look like? Toolset gets looked at through the eyes of a lodging system and we let the agent deal with stays and turnover. Because guess what, you do all that stuff too at home you just don’t get paid for it…

Very good. There is a little Bed and Breakfast a few miles away from me and I used to work with someone in the family that runs it. Nice folks, but then small towns are like that. And I have no doubt running one is like running your home on steroids, so providing this sort of functionality will help spread the appeal of ZenOS.

Yeh I have to think through housekeeping processes, turnover generated inventory moves and chores, coordinating preferences and needs, maintaining historical reference, pluggabke search providers across multi backend systems in a single pass.

I’ll save RM v.next for next week. IF I can make this experiment work… :smiling_face_with_horns:

I’m sure you can in some way.

Ok team - here’s what’s coming in v.next with RM.

Yeah nice spaghetti huh? That’s a representation of up until now how Friday has maintained her room awareness. Thats the flow for ONE of the rooms in the house - but if you look closely, the big blob on the left are all inputs and the big blob on the right is a big honkin’ state engine (subflow) responding to the inputs and resolving to a single state. (Badly I may add, no you can’t have the code it’s real bad- like there’s a reason I never published it.)

When I was on SmartThings I used a program called RoomManager from a contributor named bangali who I think MAY be on this forum too - I don’t want to incorrectly tag someone. B if that’s you Let me know, you get an attribution for v.next. This thing treated each room like an object with attributes. AND maintained a STATE for that room.

This is that magic unicorn people who are looking for a scene to have state… (Which for the record I’m vehemently against - let a scene be a scene if you need state write it yourself - or let me do it.)

When I moved to HA I was a NR guy and I ported the stuff I wanted to keep out of Bangali’s code - it’s still basically his flow in NR with a lot of unnecessary looping designed to reuse a central core and plug in room modules of sensors and things. (Interface block, code block.)

Ok still with me?

SO a year or so ago I decided I wanted to remove NR and go core automations, but holy MagiKarp that thing had grown into a platform on its own, and I needed a few things in HA before it worked the way I wanted. That was basically a way of abstracting each room without having to create a mass of templates or slam a ton of ents in a script…

2026.6 hit and made purpose triggers a shipped item (out of labs) AND we now have template blueprints.

So it’s now theoretically possible to trigger on any door open / close and - Route it to the right script to handle for the right room(s) or area(s) that need that signal. Then just like the spaghetti above, we determine what that signal means to the overall state of the room and post the current room state. (With a bunch of supporting why attributes)

Translation - tag a rooms stuff with a label representing ‘this is the thing i want to pay attention to for that here’ and Boom - instant room salience, ‘What is going on here…’ After running it through the summarizer. (which gets picked up in the supersummary loop)

Early when I was developing how the context composition looked I thought Wouldn’t it be nice of I had instant home awareness, ‘what’s going on?’ Apparently so did allenporter - (owner for the MCP integrations, and a few others in core) because I found his repo that created a summary sensor for each ‘room’

That’s what this release is going to start to do. RM will gain the ability to setup room summaries and include them in the summary engine - Do it right and your Agent suddenly has something that feels like omniscience about what’s going on where.

This is why the long beta. For those who are interested and want to play, the Room Summary engine gets added to 2026.9.0. Label driven reflexes for your agent. (Because not everything needs to be an inference call, in fact most should NOT.)

In 9.1 or 10.0 we’ll start dispatching scenes based on the result of settling a room state. :slight_smile: (I’ve been doing this with my NR version for two years, that parts pretty cool too)

Hospitality services start with understanding what’s going on… :slight_smile: And you’re going to help me retire NR once and for all in my install.

I mean seriously - I have 14 of those Points to the top

I assume you’re using Bermuda Triangulation for precise location tracking, among other methods.

Yep - That’s 10 timeframe probably. You’ll notice the code to read the structures coming in 9.0. Tag your authoritative Bermuda and/or BPS Sensor and - now we know WHERE you are inside that carefully composed structure up there…

For 9 we’ll get good old fashioned Pir and other things. Lock in to the sensor packs of a room get the schema locked in. I think you’ll like how I solved it. It’s as easy as I could make it. Not as bad as it sounds, I’ve managed a compromise that makes the room configurable for how you use it, exposes controls for people to set their prefs, and does it in one optional blueprint and up to 4 helpers per room - also optional. The tool escalates up in capability as you add structure and tag it.

Resolves something like

Kim’s in the kitchen and there’s a Mango in there - better save her…

(Room state + live presence + allergy / prefs)

Sounds about the way I would do it. The layered approach is the best way to not only know that someone is in a given room, but who it is that’s in there.

If you’re interested that’s what the lens bus is for. Anything you can represent as ‘evidence’ that can be tagged relevant to one of the core HA constructs and labeled and can be applied as enrichment to the inspect tool (most of the visible pipeline uses this under the hood) and is offered as an enrichment service to any tool consuming lens bus.

Read Library, Inspect, and RoomManager together looking at how they reference each other is probably the best view of how that works.

So essentially every time we add something, I build a lens provider for it - map the outputs and letr rip if something has ‘context’ for ‘area’ it’s offered for the LLM to grab.

Room Manager +inventory… +library +climate +lighting +media +foo

I will add that to the reading list for when I create PowerMonitor, which will read status from my solar power systems and let me know of any issues.

Hit me up when you do Ill help you make sure it registers in Plant. Tool. (all the physical plant stuff.)

Id be interested in what’s already showing up for you.

Edit. And the reflex actions may have just moved into 9.0 base.

Also in case ANYONE ASKS - September → now - It’s less than a YEAR OK? Soon-ish…

Timer tool coming in - Built-in support for the/mcp same constructs Simple Timer card uses. Think dashboard for timers, schedules and timer like things that should enrich a room they’re in.

Nice, for those folks that need the information about active timers if they leave the room where they have one running.

Early Beta folks!

I’ve got a pretty serious component coming in this one and it’s going to need a lot of looks.

You’ve all had 1/3 of Room Manager to date. This one ships the rest.

RM will not only provide semantic rooting in the map of your home but now will also act as the authoritative consolidator for live room state. (Yes, there’s a difference - read the docs) and Reflex. Your rooms can now act on their own. Again - more read…

The kids put together an operator’s manual for us this time for the new feaure due to it’s size. (yeah she chonky).

Ever have a C64 / or an 8 Bit Nintendo?You should feel right at home.

╔══════════════════════════════════════════════════════════════════╗
║                                                                    ║
║       Z E N O S - A I   H O M E   S Y S T E M S   presents        ║
║                                                                    ║
║   ██████╗  ██████╗  ██████╗ ███╗   ███╗                          ║
║   ██╔══██╗██╔═══██╗██╔═══██╗████╗ ████║                          ║
║   ██████╔╝██║   ██║██║   ██║██╔████╔██║                          ║
║   ██╔══██╗██║   ██║██║   ██║██║╚██╔╝██║                          ║
║   ██║  ██║╚██████╔╝╚██████╔╝██║ ╚═╝ ██║   M A N A G E R           ║
║   ╚═╝  ╚═╝ ╚═════╝  ╚═════╝ ╚═╝     ╚═╝                          ║
║                                                                    ║
║                ═══  O P E R A T O R ' S   M A N U A L  ═══        ║
║                                                                    ║
║          "Your devices know where they are. Now your rooms       ║
║                       know what they're doing."                   ║
║                                                                    ║
║    MODEL: ROOM MANAGER v3          CARTRIDGE: REFLEX ENGINE       ║
║    PLAYERS: 1 HOUSEHOLD            SKILL LEVEL: SET & FORGET      ║
║                                                                    ║
╚══════════════════════════════════════════════════════════════════╝

Yeh my BBS ASCII art is WAY out of practice and needs work…

zenos-ai/zenos_ai/docs/getting_started/room_manager_operators_manual.md at feat/2026.9.0 · nathan-curtis/zenos-ai

And - I won’t rat 'em out - but SOMONE found my buy me a coffee link there in the repo. You know who you are - thank you, sincerely for your generosity and my token bills thank you too.

…and In thanks they get their electrical system management moved up front. Plant will have ALL the power this build too! (yes folks I’m 100% coin operated…)

Go get checked in to the B&B… More beta fun starts now!

Would a Tandy Color Computer 3 count? :grin:

I will install this tomorrow (or is that later today?).

Trash 80, ZedX Spectrum, hell even Magnavox Odyssey 2 folk. (yes they exist. It was literally my first console and I had an actual KC’s Crazy Chase cart. If only mom hadnt struck. I’d be totally so not rich now…) but I I DO have an Atari 2600 ‘sixer’ with an ET cart that didn’t find the landfill…

She missed the Star Wars figs, Transformers and baseball cards though… Still have that Mattingly Topps rook that never got turned into a noisemaker for the Diamondback.

Yes kids. Your elder GenXers lived in Stranger Things. Less Vecna, not upside down… But yeah.

Mmmmm Trash 80. I had the CoCo 2. Was somewhat jelly of the folks at the CoCo Users group that had a Trash 80 CoCo 3!

Granted my family updated to the Tandy 1000 after that :smiley:

My first real PC was an AST Advantage that I bought at Radio Shack in early 1995.