If you just got a few entities that you like to keep track of then have a look at my 
State Notifications & Actions blueprint. You can add all the entities you would like to keep track of in one automation. The FAQ in that blueprint shows you how to include the entity name that triggered the automation in the message so you will know what entity is offline.
Blacky 