WTH Recorder applies filters when purging the database but still collect them

[eBeyond (M.)]

I was adding excludes like these to the recorder in the configuration.yaml:

recorder:
  exclude:
    entity_globs:
      - sensor.*firmware
      - update.*firmware
      - sensor.*zeitstempel
      - sensor.*sollwertanderung
      - sensor.*ssid
      - sensor.*restart_time
      - sensor.*restart_reason
      - sensor.*connect_count

after that I restarted hass to get them applied. I purged my database and after looking into the history I was happy that these are gone. But then after a few seconds: WTH… They’re coming back… The history gets filled with all these excluded entities. Why?

Cheers
Marc

[Ildar_Gabdullin]

@eBeyond

They’re coming back… The history gets filled with all these excluded entities. Why?

This a “live history”:

1. Open History page.

2. Add entities excluded from (not included to) recorder:
   

   
   
   The current state = OFF - graph shows like it has been OFF for some period (which may not be true).

3. In another browser’s tab start toggling this entity.

4. Graphs will appear:
   

   
   
   Note that the left OFF part has disappeared - nothing is displayed.
   And this is absolutely correct, this is how it should be on the 1st screenshot.
   So, we can see changes of a not recorded entity - which is useful.

5. Press F5:
   

   
   
   The last state was OFF - and mysteriously it shows like OFF from the 1st change.

I would say these inconsistencies (spanning the last known value to to beginning) not be WTH - but a github issue.

[eBeyond (M.)]

Hmmm… If I understand correctly, the history is a “live history” means: It shows all incoming data for the entities. If I’d like to see only a few entities of a device, I had to add them manually. I’ve tried to a add a area but this also shows all (also unwanted/not-recorded) entities as well.
So the solution is to get all the entities from more than 40 devices manually in a list, which looks similar to the list provided by hass, right?
This seems to be a good reason why there have been excludes for the history in the past. There have been posts mentioning that the excludes were removed from history in favor of the records: excludes. Because they’re doing that job. But it seems that they don’t. Because it’s a live-history.
The things I’d like to remove are more or less static information (firmware etc). So I don’t really need them “live”.
Cheers
Marc