CoPilot and Voice Preview

I have Copilot for my business, and would love to interact or tap into my copilot from the HomeAssistant voice preview. CoPilot reads emails, teams, files, calendar and more to tap that would be AMAZING.

2 Likes

You need Microsoft to release an api version of copilot. (which does not exist) When you want ‘copilot’ in api form from ms you’re asking for Azure OpenAI. (which Is just Microsoft running the model instead of OAI)

Copilot chat is nothing special when compared to chatgpt. (it is a customized gpt4, now gpt5)

Now I WOULD like access to an api form of Copilot for M365… Which differs in its access to the M365 graph api… But that doesn’t exist. Instead use the MS365 integration out of HACS and use any LLM.

So use OpenAI. It’s basically the same thing for what you can connect to.

Looks like there is a m365 cp API now: Microsoft 365 Copilot APIs Overview | Microsoft Learn

Those api allow access to inferences made by copilot. Not ms365 data. (thays available too)

They’re great and…

So what this allows you to do… It allows copilot inference access. Which means you can access copilot to ask about graph data inside the firewall and provide a summary… ‘Copilot tell me about the meeting I was in with Mark.’ (notice not set a meeting or reschedule a meeting… This is what happens IN the meeting)

It does notd Drive a ha install. So it’s worthwhile as aa info tool. But will be the absolute most expensive way to do it. Because you’ll still need an external llm to access copilot…

That said for most of the stuff this can give you. There’s an entire graph api for ms365 that you can access WITHOUT t copilot… In fact most of your ms365 data cN be accessed with a set of integrations from HACS…

I’ve already built most of these into tools for Friday… I’ve already released calendar and ToDo mail still needs some work. Calendar and ToDo work for all integrations but mail is currently ms365 specific I’m working on that. Requires Roger’s integrations if you want ms365 access.

She has general CRUD access for most of the important personal assistant functions. - without a copilot license.

The copilot api ONLY adds the ability to reason on internal ms graph data.

So yay they built the api. And still probably won’t recommend using it in this use case… Use standard ms graph api with an external llm.

(also… my day job deals directly with this kind of situation, copilot and Microsoft. Heck, I SELL copilot in Edu… and I would tell my clients the exact same thing. Something to the effect…
I’m glad you have access to M365 copilot and it’s probably not what you want to use here…)

1 Like