CaptTom
March 22, 2022, 1:29pm
20
I was where you were a while ago. It’s frustrating to get hit by this, after following all the beginner documentation, just as you think things are running smoothly. I think this needs to be emphasized very early in the instructions.
Just to add a note of encouragement, my recorder database, using SQLite, on an SD card on a RPi 3B+, is hovering just over 20M. That’s M, not G.
The first thing I did was follow @tom_I ’s guide (linked above) to identify the worst offenders, and exclude them. If you don’t want to do this on a separate computer, you can install the SQLite Web add on and run the SQL commands right from HA. Even easier, you can go to your HA “history” page and see which entities change frequently. I found I could exclude lots of entities.
Next I reduced my purge_keep_days to 4. It’s very rare I’d need anything older than that, and frankly HA isn’t the best place to store long-term data anyway. Instead I write summary data about the run time of various heating system components to a flat file every day. This way I can analyze it using much better tools on my laptop.
boheme61 gave a good overview of other things which have been tacked onto the Recorder database lately. Once you get your entities under control, you might want to look into the statistics tables and see if those meet your needs or if they’re something you can purge manually on some schedule. I’ve now gotten into a routine where I manually (using DB Browser on my laptop) purge statistics and re-pack the database each time I do a version update of HA.
You can also purge and re-pack the database, or individual entities, right within HA. In Developer / Tools / Services, look for Recorder: Purge and Recorder Purge Entities. As you identify the worst offenders and exclude them, you can go back here and purge them for some instant gratification as you see your database shrink.
2 Likes
I fu, when i ones trying to use DB-Browser to “compact” from Windows ( thou HA was running … i know
LOL , i’ve missed the part of using DeveloperTools/Services
Thx.
CaptTom
March 22, 2022, 5:49pm
22
It’s a long story. I’ve gotten to the point where I only update HA once per month. Usually after the point updates stop coming every 2-3 days. Instead of doing the update from within the UI, I connect via SSH and do an orderly shutdown of the core. I can also do a backup from there. Then I copy the backup to my NAS and copy the database to a temp directory on my laptop. That makes it easy to clean up the database using DB Browser on my laptop. I rename the original database and copy my cleaned-up one back to the SD card HA is running from. Then I do the update via SSH, after which I can re-start the core.
Believe it or not, that’s the short version of my backup procedure. I also have a post-update test procedure. I know for a lot of people HA is just fun and games, but for me it’s important enough that I treat it like a real “production” system. Just bad habits after a career in IT running critical systems.
It’s a bit of a well-kept secret. But it’s very helpful to be able to purge the entire database back to some days-to-keep value, or purge all records from one entity, or repack the whole database. And do it all without knowing any SQL. Combined with the History page in the HA UI, you can learn a lot about your database and how to reduce its size with no SQL at all.
On a related note, I entered a Feature Request recommending the ability to set a Recorder keep_days value for each entity. This would allow you to further control database growth, so feel free to up-vote it if you agree.
2 Likes
malosaa
March 22, 2022, 6:20pm
23
What i did is exclude almost everything i don’t need via globs.
From 1st january till now my standard db is 320mb’s
But somehow my system is still using lot of gb’s i need to investigate that.
1 Like
Voted … i did twice similar backup/recover as you describe, first when i found it too big, and then when i fu, in DB-Browser
1 Like
CaptTom
March 22, 2022, 10:21pm
25
That’s a good strategy. You don’t have to worry about whether or not you should exclude every new entity when you create it, or even know when one is being created. I’m pretty disciplined about new things, and I’m now in the habit of adding them to the exclusions, so I haven’t switched over to your method. I probably would if I were starting over.
How are you doing backups to the NAS? The only ways I’ve been able to do this is to let HA create them on whatever drive HA is running on, then copy them to a NAS (or Google Drive, or whatever.)
This obviously impacts the size of the drive, and is a problem when running HA on an SD card. So once again, I submitted a Feature Request to create the backups (used to be called snapshots) directly to some external storage. Could the backups be contributing to your disk utilization?
Thanks Mate
So this is what i have setup in yaml, as i need to get some storage back to get a backup done.
I read also about the logger, but is this enough for now?
recorder:
purge_keep_days: 5
auto_purge: true
exclude:
entities:
- alarm_control_panel.aarlo_arlo_hub
- automation.ac_ac_off
- automation.advanced_medication_reminder
- automation.automation_evening_routine
- automation.daily_automation_afternoon_routine
- automation.daily_morning_routine
- automation.dry_mode_on
- automation.feed_dogs_reminder_breakfast
- automation.feed_dogs_reminder_breakfast_duplicate
- automation.galley_lights_on_off_sunset_sunrise
- automation.garage_lights
- automation.garage_lights_off
- automation.kitchen_lights_on_off_9pm_4am
- automation.lightning_strikes_detected
- automation.lights_laundry_light
- automation.motion_activated_light_with_sun_condition
- automation.new_automation_2
- automation.pantry_lights_on_off_sunset_sunrise
- automation.powder_room_lights_on_off
- automation.star_tread_lights_on_off_9pm_4am
- binary_sensor.4in1_sensor_dbd80bfe_ias_zone
- binary_sensor.aarlo_motion_dog_hotel_camera
- binary_sensor.aarlo_motion_driveway_left_camera
- binary_sensor.aarlo_motion_driveway_right_camera
- binary_sensor.aarlo_motion_front_yard_camera
- binary_sensor.aarlo_motion_laundry_courtyard_camera
- binary_sensor.aarlo_motion_pool_camera_4k
- binary_sensor.aarlo_motion_video_doorbell
- binary_sensor.above_horizon
- binary_sensor.ac_filter
- binary_sensor.animateaxe29
- binary_sensor.back_garage_door
- binary_sensor.back_garage_door_vibration
- binary_sensor.bed_4_motion
- binary_sensor.brad_s_phone_high_accuracy_mode
- binary_sensor.captainballz926
- binary_sensor.check_home_assistant_configuration_running
- binary_sensor.check_home_assistant_configuration_update_available
- binary_sensor.dining_sliding_door
- binary_sensor.dining_sliding_door_vibration
- binary_sensor.dog_door_status
- binary_sensor.dryer_dry_completed
- binary_sensor.dryer_error_state
- binary_sensor.erifit_twert
- binary_sensor.front_door_status
- binary_sensor.front_door_vibration
- binary_sensor.galley_kitchen_motion
- binary_sensor.garage_door_status
- binary_sensor.garage_left_motion
- binary_sensor.garage_left_motion_toggle
- binary_sensor.garage_nook_motion
- binary_sensor.home_assistant_operating_system_update_available
- binary_sensor.internal_garage_door
- binary_sensor.kitchen_motion_sensor
- binary_sensor.kitchen_sink_water_detection
- binary_sensor.laundry_door_accelerometer
- binary_sensor.laundry_door_status
- binary_sensor.laundry_motion_status
- binary_sensor.linen_door
- binary_sensor.linen_room_motion
- binary_sensor.master_bedroom_balcony_door
- binary_sensor.master_bedroom_balcony_door_vibration
- binary_sensor.master_shower_motion_sensor
- binary_sensor.master_wir_motion
- binary_sensor.media_sliding_door
- binary_sensor.media_sliding_door_vibration
- binary_sensor.powder_room_motion_status
- binary_sensor.pure_mop_attached
- binary_sensor.pure_water_box_attached
- binary_sensor.remote_ui
- binary_sensor.rpi_power_status
- binary_sensor.s5_mop_attached
- binary_sensor.s5_water_box_attached
- binary_sensor.samjin_water_deb20b01_ias_zone
- binary_sensor.samsung_fold_high_accuracy_mode
- binary_sensor.samsung_fold_is_charging
- binary_sensor.security_doors
- binary_sensor.stairs_motion_sensor
- binary_sensor.studio_code_server_running
- binary_sensor.studio_code_server_update_available
- binary_sensor.sunset_patio_door
- binary_sensor.sunset_patio_door_vibration_sensor
- binary_sensor.terminal_ssh_running
- binary_sensor.terminal_ssh_update_available
- binary_sensor.updater
- binary_sensor.void_lounge_door_vibration
- binary_sensor.void_sliding_door
- binary_sensor.washing_machine_error_state
- binary_sensor.washing_machine_wash_completed
- button.lumi_lumi_plug_35d63802_identify
- button.lumi_lumi_plug_identify
- button.scan_clients_the_hampton_s_plex
- camera.aarlo_dog_hotel_camera
- camera.aarlo_driveway_left_camera
- camera.aarlo_driveway_right_camera
- camera.aarlo_front_yard_camera
- camera.aarlo_laundry_courtyard_camera
- camera.aarlo_pool_camera_4k
- camera.aarlo_video_doorbell
- camera.s5_vacuum_map
- camera.s6_vacuum_map
- climate.ac_controls_interface
- cover.bed3_ac_zone
- cover.bed4_ac_zone
- cover.bedroom_2_ac_zone
- cover.dogs_area
- cover.downstairs_ac_zones
- cover.kitchen
- cover.laundry_blinds
- cover.laundry_door_blind
- cover.laundry_window_blind
- cover.master_bedroom_ac_zone
- cover.master_bedroom_door_blind
- cover.media_room_ac_ducted_zone
- cover.office_and_gin_ac_ducted_zone
- cover.upstairs_ac_zones_not_inc_gb_s
- cover.upstairs_lounge_ac_zone
- device_tracker.brad_s_phone
- device_tracker.cloudbr34k_desktop
- device_tracker.colorado
- device_tracker.lauren_s_z_fold3
- device_tracker.samsung_fold
- device_tracker.smart_tv
- device_tracker.smart_tv_2
- device_tracker.steelseries_arctis_9x_headset
- device_tracker.tv_samsung_q80_series_75
- fan.bed2_ceiling_fan
- fan.bed3_ceiling_fan
- fan.bed4_ceiling_fan
- fan.master_bedrom_ceiling_fan
- group.awesome_people
- group.brad_and_lauren
- input_boolean.feed_dogs_reminder
- input_boolean.medication
- input_datetime.feed_dogs
- light.aarlo_dog_hotel_camera
- light.aarlo_driveway_left_camera
- light.aarlo_driveway_right_camera
- light.aarlo_front_yard_camera_light
- light.aarlo_laundry_courtyard_camera
- light.aarlo_pool_camera_4k
- light.back_patio_light_switch
- light.backyard_spotlights_group
- light.bed2_ceiling_fan_light
- light.bed2_ens_exhaust_fan
- light.bed2_ens_light_switch
- light.bed2_lamps_group
- light.bed2_left_lamp
- light.bed2_right_lamp
- light.bed2_wir_light_switch
- light.bed3_ceiling_fan_light
- light.bed3_ens_exhaust_fan_switch
- light.bed3_ens_light_switch
- light.bed3_lamps_group
- light.bed3_left_lamp
- light.bed3_right_lamp
- light.bed3_wir_light_switch
- light.bed4_ceiling_fan_light
- light.bed4_ens_exhaust_fan
- light.bed4_ens_light_switch
- light.bed4_wir_light_switch
- light.beergarden_spotlight_switch
- light.brads_bedside_lamp
- light.brads_downlight_switch
- light.brads_wir_light_switch
- light.corner_downlight
- light.dining_room_light_switch
- light.dining_room_pendant_light_switch
- light.fireplace
- light.fp_pendant_b1
- light.fp_pendant_b2
- light.fp_pendant_b3
- light.fp_pendant_b4
- light.front_door_downlight
- light.front_facade_left_wall_lamp
- light.front_facade_lights_group
- light.front_facade_right_wall_lamp
- light.front_patio_left_downlight
- light.front_patio_pendant_group
- light.front_patio_right_downlight
- light.g_and_t_light_switch
- light.g_and_t_pendant_light_switch
- light.galley_kitchen_light_switch
- light.garage_nook_light_switch
- light.group_front_facade_game_lights_1
- light.group_front_facade_game_lights_2
- light.guest_bedroom_bedside_lamps_group
- light.indoor_pendant_lights_group
- light.kitchen_pendant_light_switch
- light.kitchen_strip_light_switch
- light.laundry_light_switch
- light.laundry_spotlights_group
- light.laurens_bedside_lamp
- light.laurens_downlight_switch
- light.linen_light_switch
- light.main_garage_light_switch
- light.main_kitchen_light_switch
- light.master_balcony_downlight
- light.master_bedroom_ceiling_fan_light
- light.master_bedroom_downlights_group
- light.master_bedroom_light_switch
- light.master_bedroom_light_switch_2
- light.master_bedside_lamps_group
- light.master_ens_exhaust_fan_switch
- light.master_ens_light_switch
- light.master_toilet_light_switch
- light.master_wir_light_switchs
- light.midnight_guidence_lights_group
- light.mouse_lamp_level_light_color_on_off
- light.office_light_switch
- light.outside_laundry_spotlight_switch
- light.outside_spotlights_group
- light.pantry_light_switch
- light.pool_spotlight_switch
- light.powder_room_light_switch_and_fan
- light.powder_room_pendant_light_switch
- light.sidelane_spotlights_switch
- light.stair_landing_downlight
- light.stair_light_switch
- light.stair_pendant_light_switch
- light.sunset_patio_light_switchs
- light.upstairs_lounge_lamp
- light.upstairs_lounge_light_switch
- light.upstairs_lounge_light_switchs_on_off_3
- light.upstairs_lounge_light_switchs_on_off_4
- light.void_lounge_pendant_light_switch
- light.watertank_spotlight_switch
- media_player.brad_s_xbox_series_x
- media_player.dining_room_sonos_5
- media_player.lg_tv
- media_player.plex_plex_for_samsung_tv_2020
- media_player.plex_plex_web_chrome
- media_player.spotify_brad_applegate
- media_player.void_room_sonos_5
- number.dining_room_sonos_5_bass
- number.dining_room_sonos_5_treble
- number.void_room_sonos_5_bass
- number.void_room_sonos_5_treble
- persistent_notification.supervisor_issue_free_space
- person.brad
- person.gaye
- person.lauren
- script.1645856432130
- script.1645908222596
- script.1647944259040
- script.ac_all_zones_closed_and_off
- script.ac_cool_mode
- script.ac_cool_mode_bedtime
- script.ac_dry_mode
- script.camera_request_snapshot
- script.camera_stream_cameras_to_samsung_tv
- script.facade_lighting_brads_bday_theme
- script.facade_lighting_broncos
- script.facade_lighting_cool_white_theme
- script.facade_lighting_easter_theme
- script.facade_lighting_halloween
- script.facade_lighting_laurens_bday
- script.facade_lighting_xmas_theme
- script.lights_turn_off_all_lights
- script.plex_refresh_tv_shows
- script.routine_afternoon
- script.routine_bedtime
- script.routine_evening
- script.routine_in_bed
- script.routine_morning
- script.spotify_playlist_saturday_morning_chill
- script.turn_on_diffuser_for_1_hr
- script.vacuum_start_vacuums
- select.ac_myzone
- select.mode
- sensor.4in1_sensor_dbd80bfe_illuminance
- sensor.4in1_sensor_dbd80bfe_power
- sensor.ac_time_to_off
- sensor.ac_time_to_on
- sensor.astronomical_dawn
- sensor.astronomical_daylight
- sensor.astronomical_dusk
- sensor.astronomical_night
- sensor.average_downstairs_humdity
- sensor.average_downstairs_humidity_rounded
- sensor.average_downstairs_temperature
- sensor.average_downstairs_temperature_rounded
- sensor.back_garage_door_power
- sensor.bed2_climate_humidity
- sensor.bed2_climate_power
- sensor.bed2_climate_temperature
- sensor.bed2_ens_climate_humidity
- sensor.bed2_ens_climate_power
- sensor.bed2_ens_climate_temperature
- sensor.bed2_remote_power
- sensor.bed3_climate_humidity
- sensor.bed3_climate_power
- sensor.bed3_climate_temperature
- sensor.bed3_ens_climate_humidity
- sensor.bed3_ens_climate_power
- sensor.bed3_ens_climate_temperature
- sensor.bed3_remote_power
- sensor.bed4_climate_humidity
- sensor.bed4_climate_power
- sensor.bed4_climate_temperature
- sensor.bed4_ens_climate_humidity
- sensor.bed4_ens_climate_power
- sensor.bed4_ens_climate_temperature
- sensor.bed4_motion_power
- sensor.beerburrum_gust_speed_kilometre
- sensor.beerburrum_humidity
- sensor.beerburrum_temp
- sensor.beerburrum_temp_feels_like
- sensor.beerburrum_wind_direction
- sensor.beerburrum_wind_speed_kilometre
- sensor.bells_creek_fire_danger_0
- sensor.bells_creek_rain_amount_max_0
- sensor.bells_creek_rain_amount_min_0
- sensor.bells_creek_rain_amount_range_0
- sensor.bells_creek_rain_chance_0
- sensor.bells_creek_short_text_0
- sensor.bells_creek_temp_max_0
- sensor.bells_creek_temp_min_0
- sensor.bells_creek_uv_category_0
- sensor.bells_creek_uv_max_index_0
- sensor.brad_s_phone_geocoded_location
- sensor.brad_s_phone_pressure_sensor
- sensor.brad_s_phone_wifi_connection
- sensor.cash_factor_fronius_logger_info
- sensor.check_home_assistant_configuration_newest_version
- sensor.check_home_assistant_configuration_version
- sensor.civil_daylight
- sensor.civil_night
- sensor.co2_factor_fronius_logger_info
- sensor.current_ac_fronius_inverter
- sensor.current_dc_fronius_inverter
- sensor.current_pool_temperature
- sensor.current_version
- sensor.dawn
- sensor.daylight
- sensor.delivery_factor_fronius_logger_info
- sensor.dining_climate_humidity
- sensor.dining_climate_power
- sensor.dining_climate_temperature
- sensor.dining_sliding_door_power
- sensor.dishwasher_plug_electrical_usage_wattage
- sensor.dishwasher_plug_power
- sensor.dishwasher_plug_temperature
- sensor.dog_door_power
- sensor.dryer_current_course
- sensor.dryer_dry_level
- sensor.dryer_error_message
- sensor.dryer_plug_electrical_usage_wattage
- sensor.dryer_plug_temperature
- sensor.dryer_process_state
- sensor.dryer_run_state
- sensor.dryer_status
- sensor.dusk
- sensor.elevation
- sensor.energy_day_fronius
- sensor.energy_total_fronius
- sensor.energy_year_fronius
- sensor.entryway_climate_humidity
- sensor.entryway_climate_power
- sensor.entryway_climate_temperature
- sensor.envestnet_inc_stock
- sensor.error_code_fronius_inverter
- sensor.frequency_ac_fronius_inverter
- sensor.fronius_day_energy_kwh
- sensor.fronius_total_energy_mwh
- sensor.fronius_yearly_energy_kwh
- sensor.front_door_power
- sensor.g_and_t_climate_humidity
- sensor.g_and_t_climate_power
- sensor.g_and_t_climate_temperature
- sensor.galley_kitchen_climate_humidity
- sensor.galley_kitchen_climate_power
- sensor.galley_kitchen_climate_temperature
- sensor.galley_kitchen_motion_power
- sensor.garage_left_motion_power
- sensor.garage_nook_motion_power
- sensor.hacs
- sensor.home_assistant_operating_system_newest_version
- sensor.home_assistant_operating_system_version
- sensor.home_assistant_v2_db
- sensor.internal_garage_door_power
- sensor.inverter_utilisation
- sensor.kitchen_climate_display_humidity
- sensor.kitchen_climate_display_power
- sensor.kitchen_climate_display_temperature
- sensor.kitchen_climate_humidity
- sensor.kitchen_climate_power
- sensor.kitchen_climate_temperature
- sensor.kitchen_fridge_plug_electrical_measurement
- sensor.kitchen_fridge_plug_electrical_usage
- sensor.kitchen_motion_power
- sensor.kitchen_sink_water_power
- sensor.kitchen_sink_water_temperature
- sensor.laundry_climate_humidity
- sensor.laundry_climate_power
- sensor.laundry_climate_temperature
- sensor.laundry_door_power
- sensor.laundry_fridge_plug_electrical_measurement
- sensor.laundry_fridge_plug_electrical_usage
- sensor.laundry_motion_power
- sensor.laundry_sink_water_power
- sensor.led_color_fronius_inverter
- sensor.led_state_fronius_inverter
- sensor.lighting_strikes_lightning_azimuth
- sensor.lighting_strikes_lightning_counter
- sensor.lighting_strikes_lightning_distance
- sensor.linen_room_door_power
- sensor.linen_room_motion_power
- sensor.lumi_lumi_plug_35d63802_analog_input
- sensor.lumi_lumi_plug_35d63802_analog_input_2
- sensor.lumi_lumi_plug_35d63802_electrical_measurement_apparent_power
- sensor.lumi_lumi_plug_35d63802_electrical_measurement_rms_current
- sensor.lumi_lumi_plug_35d63802_electrical_measurement_rms_voltage
- sensor.lumi_lumi_plug_a0342d03_analog_input_2
- sensor.lumi_lumi_plug_a0342d03_electrical_measurement_apparent_power
- sensor.lumi_lumi_plug_a0342d03_electrical_measurement_rms_current
- sensor.lumi_lumi_plug_analog_input
- sensor.lumi_lumi_plug_analog_input_2
- sensor.lumi_lumi_plug_electrical_measurement_apparent_power
- sensor.lumi_lumi_plug_electrical_measurement_rms_current
- sensor.lumi_lumi_plug_electrical_measurement_rms_voltage
- sensor.make_up_table_plug_electrical_measurement
- sensor.make_up_table_plug_electrical_usage
- sensor.master_bedroom_balcony_door_power
- sensor.master_bedroom_climate_humidity
- sensor.master_bedroom_climate_power
- sensor.master_bedroom_climate_temperature
- sensor.master_ens_climate_humidity
- sensor.master_ens_climate_power
- sensor.master_ens_climate_temperature
- sensor.master_shower_motion_sensor_power
- sensor.master_wir_motion_power
- sensor.max_elevation
- sensor.media_climate_humidity
- sensor.media_climate_power
- sensor.media_climate_temperature
- sensor.media_sliding_door_power
- sensor.meter_mode_fronius_power_flow
- sensor.min_elevation
- sensor.nautical_dawn
- sensor.nautical_daylight
- sensor.nautical_dusk
- sensor.nautical_night
- sensor.nbn_billing_cycle_length
- sensor.nbn_billing_cycle_remaining
- sensor.nbn_data_used
- sensor.nbn_downloaded
- sensor.nbn_uploaded
- sensor.night
- sensor.office_formaldehyde_level
- sensor.office_multi_climate_carbon_dioxide_concentration
- sensor.office_multi_climate_formaldehyde_concentration
- sensor.office_multi_climate_humidity
- sensor.office_multi_climate_temperature
- sensor.office_multi_climate_voc_level
- sensor.openweathermap_cloud_coverage
- sensor.openweathermap_condition
- sensor.openweathermap_dew_point
- sensor.openweathermap_feels_like_temperature
- sensor.openweathermap_forecast_cloud_coverage
- sensor.openweathermap_forecast_condition
- sensor.openweathermap_forecast_precipitation
- sensor.openweathermap_forecast_precipitation_probability
- sensor.openweathermap_forecast_pressure
- sensor.openweathermap_forecast_temperature
- sensor.openweathermap_forecast_temperature_low
- sensor.openweathermap_forecast_time
- sensor.openweathermap_forecast_wind_bearing
- sensor.openweathermap_forecast_wind_speed
- sensor.openweathermap_humidity
- sensor.openweathermap_precipitation_kind
- sensor.openweathermap_pressure
- sensor.openweathermap_rain
- sensor.openweathermap_snow
- sensor.openweathermap_temperature
- sensor.openweathermap_uv_index
- sensor.openweathermap_weather
- sensor.openweathermap_weather_code
- sensor.openweathermap_wind_bearing
- sensor.openweathermap_wind_speed
- sensor.plex_the_hampton_s_plex
- sensor.powder_room_motion_power
- sensor.power_ac_fronius_inverter
- sensor.project_zero_three_diesel
- sensor.project_zero_three_e10
- sensor.project_zero_three_lpg
- sensor.project_zero_three_u91
- sensor.project_zero_three_u95
- sensor.project_zero_three_u98
- sensor.pure_current_clean_area
- sensor.pure_current_clean_duration
- sensor.pure_dnd_end
- sensor.pure_dnd_start
- sensor.pure_filter_left
- sensor.pure_last_clean_area
- sensor.pure_last_clean_duration
- sensor.pure_last_clean_end
- sensor.pure_last_clean_start
- sensor.pure_main_brush_left
- sensor.pure_sensor_dirty_left
- sensor.pure_side_brush_left
- sensor.pure_total_clean_area
- sensor.pure_total_clean_count
- sensor.pure_total_duration
- sensor.s5_current_clean_area
- sensor.s5_current_clean_duration
- sensor.s5_dnd_end
- sensor.s5_dnd_start
- sensor.s5_filter_left
- sensor.s5_last_clean_area
- sensor.s5_last_clean_duration
- sensor.s5_last_clean_end
- sensor.s5_last_clean_start
- sensor.s5_main_brush_left
- sensor.s5_sensor_dirty_left
- sensor.s5_side_brush_left
- sensor.s5_total_clean_area
- sensor.s5_total_clean_count
- sensor.s5_total_duration
- sensor.sally_cres_sunrise
- sensor.sally_cres_sunset
- sensor.samsung_fold_battery_health
- sensor.samsung_fold_battery_level
- sensor.samsung_fold_battery_state
- sensor.samsung_fold_battery_temperature
- sensor.samsung_fold_charger_type
- sensor.samsung_fold_detected_activity
- sensor.samsung_fold_geocoded_location
- sensor.samsung_fold_pressure_sensor
- sensor.samsung_fold_proximity_sensor
- sensor.samsung_fold_sleep_confidence
- sensor.samsung_fold_sleep_segment
- sensor.samsung_fold_steps_sensor
- sensor.seasons
- sensor.set_pool_temperature
- sensor.solar_midnight
- sensor.solar_noon
- sensor.stairs_climate_power
- sensor.stairs_humidity
- sensor.stairs_motion_power
- sensor.stairs_temperature
- sensor.status_code_fronius_inverter
- sensor.studio_code_server_cpu_percent
- sensor.studio_code_server_memory_percent
- sensor.studio_code_server_newest_version
- sensor.studio_code_server_version
- sensor.sunrise
- sensor.sunset
- sensor.sunset_patio_door_power
- sensor.terminal_ssh_cpu_percent
- sensor.terminal_ssh_memory_percent
- sensor.terminal_ssh_newest_version
- sensor.terminal_ssh_version
- sensor.the_hampton_s_plex_library_movies
- sensor.the_hampton_s_plex_library_tv_shows
- sensor.upstairs_lounge_climate_humidity
- sensor.upstairs_lounge_climate_power
- sensor.upstairs_lounge_climate_temperature
- sensor.void_lounge_climate_humidity
- sensor.void_lounge_climate_power
- sensor.void_lounge_climate_temperature
- sensor.void_lounge_door_power
- sensor.voltage_dc_fronius_inverter
- sensor.washing_machine_current_course
- sensor.washing_machine_error_message
- sensor.washing_machine_plug_temperature
- sensor.washing_machine_plug_wattage
- sensor.washing_machine_run_state
- sensor.washing_machine_spin_speed
- sensor.washing_machine_status
- sensor.washing_machine_water_temp
- sun.sun
- switch.aarlo_all_sirens
- switch.aarlo_siren_dog_hotel_camera
- switch.aarlo_siren_driveway_left_camera
- switch.aarlo_siren_driveway_right_camera
- switch.aarlo_siren_front_yard_camera
- switch.aarlo_siren_laundry_courtyard_camera
- switch.aarlo_siren_pool_camera_4k
- switch.aarlo_snapshot_dog_hotel_camera
- switch.aarlo_snapshot_driveway_left_camera
- switch.aarlo_snapshot_driveway_right_camera
- switch.aarlo_snapshot_front_yard_camera
- switch.aarlo_snapshot_laundry_courtyard_camera
- switch.aarlo_snapshot_pool_camera_4k
- switch.aarlo_snapshot_video_doorbell
- switch.diffuser_toggle
- switch.dishwasher_plug_switch
- switch.dryer_plug_switch
- switch.dryer_power_off
- switch.electric_towel_heater_switch
- switch.garage_door_opener
- switch.kitchen_fridge_plug_switch
- switch.laundry_fridge_plug_switch
- switch.make_up_table_plug_switch
- switch.no_name_group_0x0000_zha_group_0x0000
- switch.plug_usb_1_switch
- switch.plug_usb_2_switch
- switch.plug_usb_3_switch
- switch.pool_heater_switch
- switch.quad_board_2_garage_on_off
- switch.sonos_dining_room_sonos_5_crossfade
- switch.sonos_void_room_sonos_5_crossfade
- switch.tz3000_o005nuxx_ts011f_10cc03fe_on_off_2
- switch.tz3000_o005nuxx_ts011f_10cc03fe_on_off_3
- switch.tz3000_o005nuxx_ts011f_10cc03fe_on_off_4
- switch.tz3000_o005nuxx_ts011f_10cc03fe_on_off_5
- switch.tz3000_o005nuxx_ts011f_99cc03fe_on_off
- switch.tz3000_o005nuxx_ts011f_99cc03fe_on_off_2
- switch.tz3000_o005nuxx_ts011f_99cc03fe_on_off_3
- switch.tz3000_o005nuxx_ts011f_99cc03fe_on_off_4
- switch.tz3000_o005nuxx_ts011f_99cc03fe_on_off_5
- switch.void_curtains
- switch.washing_machine_plug_switch
- switch.washing_machine_power_off
- timer.ac_timer
- timer.lights_timer
- timer.pool_pump
- vacuum.pure_s6_vacuum
- vacuum.s5
- weather.bells_creek_hourly
- weather.bells_creek_weather
- weather.openweathermap
- zone.brads_parents_home
- zone.bunnings_caloundra
- zone.home
- zone.the_golden_hour
- zone.upyourself_training
yeah i think ill do the same then re add the ones i want to include.
Im going to move to a dedicated NUC or just attached an ssd harddrove to my pi4
CaptTom
March 22, 2022, 10:26pm
28
Yes, your exclusion list is longer than mine. It should help a lot.
I don’t think Logger exclusions would help. The documentation implies that you can exclude things from Logger separately from excluding them from Recorder. But it also implies that Logger uses the data that Recorder records. Looking at the database, I don’t see any Logger data. So I don’t think excluding anything from Logger after already excluding from Recorder is going to make any difference. If someone has more information, I’d love to hear it.
yeah ok thought so, i guess its just waiting now
Disk Total
29.0 GB
Disk Used
27.6 GB
CaptTom
March 23, 2022, 12:12am
30
I’m not as patient as you. I’d go into Developer Tools / Services and purge some entities right away.
Plus, purging (including the daily purge based on your purge_keep_days) doesn’t do a repack. The Recorder: Purge service can, but the UI is a little confusing. You have to select the check box on the left and turn on the slider on the right. A repack is the only way to reduce the database size.
how do you know if its worked??
well my Statistics is now showing im not recording on alot of entities now, so thats a start.
im trying to see if i ahve done a repack, but cant see my file size changing
you have to click the toggle switch for Repack also, for it to work
avd706
March 23, 2022, 2:33am
34
use supervisor to install mariadb
add one line to your configuration.yaml
Nah that didn’t work. I must have recorder not working correctly.
So I need to remove default config from.yaml?
i cant, it says i dont have enough space
hey guys, im struggling here. I have followed the document on how to purge, but i dont think its doing anything
Suggestions please??
If you did click the “toggle” to the right, under days, and Unchecked “Days to keep” … then clicked “call service” ( only for Repack Service ), if that don’t work, i guess thats also because you have to little diskspace/memory to handle such a big Task/DB,
Right now I don’t care about my stats
So how do I delete the database?
) … how do you use DB-Browser on regular basis ? , or you always use the HA-SQLite Web add on, for that ?
… no more(or less) manual job writing, in sql/yaml 
(trying to skip the “safe-run”)… and yes it’s not “trivial” but first time i was hitting the roof, on the “default” 32GB disk-image-size i initially made, last October, second time i also increased disk-image to 60GB ( i run an VMw in Windows, but VM on another Disk(2 disks assigned to HA/DB/Files, exFat ) ( Funny is, you know the feeling when something feels wrong or will go wrong, and think, … but i try 
, just to confirm … but it seems “stable” now at around 650MB, and just reduced size 30%, through DEV/SERV, after reading your post 
, maybe will be a “monthly” routines from now i think, i run with 30days purge.
