I would look at some posts from this section of the cookbook.
The Home Assistant Cookbook - Index.
You might have an SD/memory/drive problem in the CM4.
You could have an integration slowing you up.
You could have a bad network patch cable or switch.