Not sure if this is what your are after but just brain storming.
I would have a notification that would send a message to my phone if the light is ON for X amount of time and motion is OFF. Then I would have an action button in the message were I can decide if I would like to turn the light OFF.
Have a look at this 
State Notifications & Actions
- Use state and your light = on
- Start Trigger - Time Delay = X amount of time the light must be ON for.
- Global Conditions = motion must be OFF.
- Action buttons = set it up to turn your light/s OFF.
Set one up for each automation.
- One light used in a automation - easy set up.
- Two or more lights used in a automation - Use one light as the state trigger and in action turn OFF add all lights.
Maybe that will work for you.
If not
You will have to set up a template sensor for when the light is ON for X and motion is OFF = turn ON else = OFF. Then use that as a trigger in a automation to turn lights OFF. But you may have them going OFF when you would like them ON hence the notification method above, you get to decide and it is only if someone leaves the light ON and the automation gets tricked (sequence of events leads to the light/s being ON) and the light stays ON.
Totally up to you… hope this helps… let us know how you go.
Blacky 