I was able to get it to work by using this template.
{{now().strftime("%a %h %d %H:%M %Z %Y") == (((state_attr('sensor.joes_galaxy_s10_next_alarm', 'Time in Milliseconds') | int / 1000) + 0*60 ) | timestamp_custom('%a %h %d %H:%M %Z %Y'))}}
and this for a binary sensor. Hopefully this will help someone else in the future
- platform: template
sensors:
joes_next_alarm:
entity_id:
- sensor.joes_galaxy_s10_next_alarm
- sensor.time
friendly_name: "Joes Next Alarm"
value_template: >-
{{now().strftime("%a %h %d %H:%M %Z %Y") == (((state_attr('sensor.joes_galaxy_s10_next_alarm', 'Time in Milliseconds') | int / 1000) + 0*60 ) | timestamp_custom('%a %h %d %H:%M %Z %Y'))}}