It is possible to reorder and remove items in the custom panel (long click on the headline), but all changes disappears after closing the browser - at least at my system: edge with clear cache when closing.
Could you please make the changes permanent (removing items, reordering items)?
My current work aroud: I exclude homeassistant.local from cleaning on exit. That seem to work.