The ZHA quirks are gathered in the zha-device-handlers github project.
If you think some quirks are wrong or unnecessary, you might want to open an issue there.
To answer your question, I’m pretty sure there is no way to remove a quirk.
I guess you might be able to override builtin ones with custom quirks of your own, though.