I’m using a entity-filter for my lights & covers.

Now is my question, is it possible to make a button of something else, so I can put all the lights off & all the open covers close?

Put them all in a group.

There is a specific group for lights:

You can use the light.turn_on/off service with that. It behaves just like a light but controlls all of the group members.

For the covers you can use the normal group:

Use the homeassistant.turn_on/off service to switch the normal group.