Is it possible to set off the alarm on an Alexa device?

you can use Alexa to do a voice announcement.

There are at least two threads running that explain how to do it.

I use the first one here: