What would you use a dimmable switch for if not a light? It makes sense to me that they are displayed as lights. I wouldn’t want it another way.
But if you really want them to show as switches, you can create a template switch. You’d lose the dimmable functionality for it - It would just be on/off. You know, like a switch.