Database already huge

I fu, when i ones trying to use DB-Browser to “compact” from Windows ( thou HA was running … i know :wink: ) … how do you use DB-Browser on regular basis ? , or you always use the HA-SQLite Web add on, for that ?

LOL , i’ve missed the part of using DeveloperTools/Services :slight_smile: … no more(or less) manual job writing, in sql/yaml :slight_smile:

Thx.

It’s a long story. I’ve gotten to the point where I only update HA once per month. Usually after the point updates stop coming every 2-3 days. Instead of doing the update from within the UI, I connect via SSH and do an orderly shutdown of the core. I can also do a backup from there. Then I copy the backup to my NAS and copy the database to a temp directory on my laptop. That makes it easy to clean up the database using DB Browser on my laptop. I rename the original database and copy my cleaned-up one back to the SD card HA is running from. Then I do the update via SSH, after which I can re-start the core.

Believe it or not, that’s the short version of my backup procedure. I also have a post-update test procedure. I know for a lot of people HA is just fun and games, but for me it’s important enough that I treat it like a real “production” system. Just bad habits after a career in IT running critical systems.

It’s a bit of a well-kept secret. But it’s very helpful to be able to purge the entire database back to some days-to-keep value, or purge all records from one entity, or repack the whole database. And do it all without knowing any SQL. Combined with the History page in the HA UI, you can learn a lot about your database and how to reduce its size with no SQL at all.

On a related note, I entered a Feature Request recommending the ability to set a Recorder keep_days value for each entity. This would allow you to further control database growth, so feel free to up-vote it if you agree.

2 Likes

What i did is exclude almost everything i don’t need via globs.
And then include only what i need, so every new device i add whats not in the globs i will add it manual.

From 1st january till now my standard db is 320mb’s
Every backup of the system is done to my NAS.

But somehow my system is still using lot of gb’s i need to investigate that.

1 Like

Voted … i did twice similar backup/recover as you describe, first when i found it too big, and then when i fu, in DB-Browser :slight_smile: (trying to skip the “safe-run”)… and yes it’s not “trivial” but first time i was hitting the roof, on the “default” 32GB disk-image-size i initially made, last October, second time i also increased disk-image to 60GB ( i run an VMw in Windows, but VM on another Disk(2 disks assigned to HA/DB/Files, exFat ) ( Funny is, you know the feeling when something feels wrong or will go wrong, and think, … but i try :grinning_face_with_smiling_eyes: , just to confirm … but it seems “stable” now at around 650MB, and just reduced size 30%, through DEV/SERV, after reading your post :wink: , maybe will be a “monthly” routines from now i think, i run with 30days purge.
Im actually pleased with the option in Services(shame i didn’t “noticed” this before, have most likely seen refers to that in some post), but Yes for new and “average” users, there should be a Simple AND well “Published” in a Tool section for Tasks like this, a release note, and some hardtofinddocsforsome, is not a good “Guide”

1 Like

That’s a good strategy. You don’t have to worry about whether or not you should exclude every new entity when you create it, or even know when one is being created. I’m pretty disciplined about new things, and I’m now in the habit of adding them to the exclusions, so I haven’t switched over to your method. I probably would if I were starting over.

How are you doing backups to the NAS? The only ways I’ve been able to do this is to let HA create them on whatever drive HA is running on, then copy them to a NAS (or Google Drive, or whatever.)

This obviously impacts the size of the drive, and is a problem when running HA on an SD card. So once again, I submitted a Feature Request to create the backups (used to be called snapshots) directly to some external storage. Could the backups be contributing to your disk utilization?

Thanks Mate

So this is what i have setup in yaml, as i need to get some storage back to get a backup done.

I read also about the logger, but is this enough for now?

recorder:
  purge_keep_days: 5
  auto_purge: true
  exclude:
    entities:
      - alarm_control_panel.aarlo_arlo_hub
      - automation.ac_ac_off
      - automation.advanced_medication_reminder
      - automation.automation_evening_routine
      - automation.daily_automation_afternoon_routine
      - automation.daily_morning_routine
      - automation.dry_mode_on
      - automation.feed_dogs_reminder_breakfast
      - automation.feed_dogs_reminder_breakfast_duplicate
      - automation.galley_lights_on_off_sunset_sunrise
      - automation.garage_lights
      - automation.garage_lights_off
      - automation.kitchen_lights_on_off_9pm_4am
      - automation.lightning_strikes_detected
      - automation.lights_laundry_light
      - automation.motion_activated_light_with_sun_condition
      - automation.new_automation_2
      - automation.pantry_lights_on_off_sunset_sunrise
      - automation.powder_room_lights_on_off
      - automation.star_tread_lights_on_off_9pm_4am
      - binary_sensor.4in1_sensor_dbd80bfe_ias_zone
      - binary_sensor.aarlo_motion_dog_hotel_camera
      - binary_sensor.aarlo_motion_driveway_left_camera
      - binary_sensor.aarlo_motion_driveway_right_camera
      - binary_sensor.aarlo_motion_front_yard_camera
      - binary_sensor.aarlo_motion_laundry_courtyard_camera
      - binary_sensor.aarlo_motion_pool_camera_4k
      - binary_sensor.aarlo_motion_video_doorbell
      - binary_sensor.above_horizon
      - binary_sensor.ac_filter
      - binary_sensor.animateaxe29
      - binary_sensor.back_garage_door
      - binary_sensor.back_garage_door_vibration
      - binary_sensor.bed_4_motion
      - binary_sensor.brad_s_phone_high_accuracy_mode
      - binary_sensor.captainballz926
      - binary_sensor.check_home_assistant_configuration_running
      - binary_sensor.check_home_assistant_configuration_update_available
      - binary_sensor.dining_sliding_door
      - binary_sensor.dining_sliding_door_vibration
      - binary_sensor.dog_door_status
      - binary_sensor.dryer_dry_completed
      - binary_sensor.dryer_error_state
      - binary_sensor.erifit_twert
      - binary_sensor.front_door_status
      - binary_sensor.front_door_vibration
      - binary_sensor.galley_kitchen_motion
      - binary_sensor.garage_door_status
      - binary_sensor.garage_left_motion
      - binary_sensor.garage_left_motion_toggle
      - binary_sensor.garage_nook_motion
      - binary_sensor.home_assistant_operating_system_update_available
      - binary_sensor.internal_garage_door
      - binary_sensor.kitchen_motion_sensor
      - binary_sensor.kitchen_sink_water_detection
      - binary_sensor.laundry_door_accelerometer
      - binary_sensor.laundry_door_status
      - binary_sensor.laundry_motion_status
      - binary_sensor.linen_door
      - binary_sensor.linen_room_motion
      - binary_sensor.master_bedroom_balcony_door
      - binary_sensor.master_bedroom_balcony_door_vibration
      - binary_sensor.master_shower_motion_sensor
      - binary_sensor.master_wir_motion
      - binary_sensor.media_sliding_door
      - binary_sensor.media_sliding_door_vibration
      - binary_sensor.powder_room_motion_status
      - binary_sensor.pure_mop_attached
      - binary_sensor.pure_water_box_attached
      - binary_sensor.remote_ui
      - binary_sensor.rpi_power_status
      - binary_sensor.s5_mop_attached
      - binary_sensor.s5_water_box_attached
      - binary_sensor.samjin_water_deb20b01_ias_zone
      - binary_sensor.samsung_fold_high_accuracy_mode
      - binary_sensor.samsung_fold_is_charging
      - binary_sensor.security_doors
      - binary_sensor.stairs_motion_sensor
      - binary_sensor.studio_code_server_running
      - binary_sensor.studio_code_server_update_available
      - binary_sensor.sunset_patio_door
      - binary_sensor.sunset_patio_door_vibration_sensor
      - binary_sensor.terminal_ssh_running
      - binary_sensor.terminal_ssh_update_available
      - binary_sensor.updater
      - binary_sensor.void_lounge_door_vibration
      - binary_sensor.void_sliding_door
      - binary_sensor.washing_machine_error_state
      - binary_sensor.washing_machine_wash_completed
      - button.lumi_lumi_plug_35d63802_identify
      - button.lumi_lumi_plug_identify
      - button.scan_clients_the_hampton_s_plex
      - camera.aarlo_dog_hotel_camera
      - camera.aarlo_driveway_left_camera
      - camera.aarlo_driveway_right_camera
      - camera.aarlo_front_yard_camera
      - camera.aarlo_laundry_courtyard_camera
      - camera.aarlo_pool_camera_4k
      - camera.aarlo_video_doorbell
      - camera.s5_vacuum_map
      - camera.s6_vacuum_map
      - climate.ac_controls_interface
      - cover.bed3_ac_zone
      - cover.bed4_ac_zone
      - cover.bedroom_2_ac_zone
      - cover.dogs_area
      - cover.downstairs_ac_zones
      - cover.kitchen
      - cover.laundry_blinds
      - cover.laundry_door_blind
      - cover.laundry_window_blind
      - cover.master_bedroom_ac_zone
      - cover.master_bedroom_door_blind
      - cover.media_room_ac_ducted_zone
      - cover.office_and_gin_ac_ducted_zone
      - cover.upstairs_ac_zones_not_inc_gb_s
      - cover.upstairs_lounge_ac_zone
      - device_tracker.brad_s_phone
      - device_tracker.cloudbr34k_desktop
      - device_tracker.colorado
      - device_tracker.lauren_s_z_fold3
      - device_tracker.samsung_fold
      - device_tracker.smart_tv
      - device_tracker.smart_tv_2
      - device_tracker.steelseries_arctis_9x_headset
      - device_tracker.tv_samsung_q80_series_75
      - fan.bed2_ceiling_fan
      - fan.bed3_ceiling_fan
      - fan.bed4_ceiling_fan
      - fan.master_bedrom_ceiling_fan
      - group.awesome_people
      - group.brad_and_lauren
      - input_boolean.feed_dogs_reminder
      - input_boolean.medication
      - input_datetime.feed_dogs
      - light.aarlo_dog_hotel_camera
      - light.aarlo_driveway_left_camera
      - light.aarlo_driveway_right_camera
      - light.aarlo_front_yard_camera_light
      - light.aarlo_laundry_courtyard_camera
      - light.aarlo_pool_camera_4k
      - light.back_patio_light_switch
      - light.backyard_spotlights_group
      - light.bed2_ceiling_fan_light
      - light.bed2_ens_exhaust_fan
      - light.bed2_ens_light_switch
      - light.bed2_lamps_group
      - light.bed2_left_lamp
      - light.bed2_right_lamp
      - light.bed2_wir_light_switch
      - light.bed3_ceiling_fan_light
      - light.bed3_ens_exhaust_fan_switch
      - light.bed3_ens_light_switch
      - light.bed3_lamps_group
      - light.bed3_left_lamp
      - light.bed3_right_lamp
      - light.bed3_wir_light_switch
      - light.bed4_ceiling_fan_light
      - light.bed4_ens_exhaust_fan
      - light.bed4_ens_light_switch
      - light.bed4_wir_light_switch
      - light.beergarden_spotlight_switch
      - light.brads_bedside_lamp
      - light.brads_downlight_switch
      - light.brads_wir_light_switch
      - light.corner_downlight
      - light.dining_room_light_switch
      - light.dining_room_pendant_light_switch
      - light.fireplace
      - light.fp_pendant_b1
      - light.fp_pendant_b2
      - light.fp_pendant_b3
      - light.fp_pendant_b4
      - light.front_door_downlight
      - light.front_facade_left_wall_lamp
      - light.front_facade_lights_group
      - light.front_facade_right_wall_lamp
      - light.front_patio_left_downlight
      - light.front_patio_pendant_group
      - light.front_patio_right_downlight
      - light.g_and_t_light_switch
      - light.g_and_t_pendant_light_switch
      - light.galley_kitchen_light_switch
      - light.garage_nook_light_switch
      - light.group_front_facade_game_lights_1
      - light.group_front_facade_game_lights_2
      - light.guest_bedroom_bedside_lamps_group
      - light.indoor_pendant_lights_group
      - light.kitchen_pendant_light_switch
      - light.kitchen_strip_light_switch
      - light.laundry_light_switch
      - light.laundry_spotlights_group
      - light.laurens_bedside_lamp
      - light.laurens_downlight_switch
      - light.linen_light_switch
      - light.main_garage_light_switch
      - light.main_kitchen_light_switch
      - light.master_balcony_downlight
      - light.master_bedroom_ceiling_fan_light
      - light.master_bedroom_downlights_group
      - light.master_bedroom_light_switch
      - light.master_bedroom_light_switch_2
      - light.master_bedside_lamps_group
      - light.master_ens_exhaust_fan_switch
      - light.master_ens_light_switch
      - light.master_toilet_light_switch
      - light.master_wir_light_switchs
      - light.midnight_guidence_lights_group
      - light.mouse_lamp_level_light_color_on_off
      - light.office_light_switch
      - light.outside_laundry_spotlight_switch
      - light.outside_spotlights_group
      - light.pantry_light_switch
      - light.pool_spotlight_switch
      - light.powder_room_light_switch_and_fan
      - light.powder_room_pendant_light_switch
      - light.sidelane_spotlights_switch
      - light.stair_landing_downlight
      - light.stair_light_switch
      - light.stair_pendant_light_switch
      - light.sunset_patio_light_switchs
      - light.upstairs_lounge_lamp
      - light.upstairs_lounge_light_switch
      - light.upstairs_lounge_light_switchs_on_off_3
      - light.upstairs_lounge_light_switchs_on_off_4
      - light.void_lounge_pendant_light_switch
      - light.watertank_spotlight_switch
      - media_player.brad_s_xbox_series_x
      - media_player.dining_room_sonos_5
      - media_player.lg_tv
      - media_player.plex_plex_for_samsung_tv_2020
      - media_player.plex_plex_web_chrome
      - media_player.spotify_brad_applegate
      - media_player.void_room_sonos_5
      - number.dining_room_sonos_5_bass
      - number.dining_room_sonos_5_treble
      - number.void_room_sonos_5_bass
      - number.void_room_sonos_5_treble
      - persistent_notification.supervisor_issue_free_space
      - person.brad
      - person.gaye
      - person.lauren
      - script.1645856432130
      - script.1645908222596
      - script.1647944259040
      - script.ac_all_zones_closed_and_off
      - script.ac_cool_mode
      - script.ac_cool_mode_bedtime
      - script.ac_dry_mode
      - script.camera_request_snapshot
      - script.camera_stream_cameras_to_samsung_tv
      - script.facade_lighting_brads_bday_theme
      - script.facade_lighting_broncos
      - script.facade_lighting_cool_white_theme
      - script.facade_lighting_easter_theme
      - script.facade_lighting_halloween
      - script.facade_lighting_laurens_bday
      - script.facade_lighting_xmas_theme
      - script.lights_turn_off_all_lights
      - script.plex_refresh_tv_shows
      - script.routine_afternoon
      - script.routine_bedtime
      - script.routine_evening
      - script.routine_in_bed
      - script.routine_morning
      - script.spotify_playlist_saturday_morning_chill
      - script.turn_on_diffuser_for_1_hr
      - script.vacuum_start_vacuums
      - select.ac_myzone
      - select.mode
      - sensor.4in1_sensor_dbd80bfe_illuminance
      - sensor.4in1_sensor_dbd80bfe_power
      - sensor.ac_time_to_off
      - sensor.ac_time_to_on
      - sensor.astronomical_dawn
      - sensor.astronomical_daylight
      - sensor.astronomical_dusk
      - sensor.astronomical_night
      - sensor.average_downstairs_humdity
      - sensor.average_downstairs_humidity_rounded
      - sensor.average_downstairs_temperature
      - sensor.average_downstairs_temperature_rounded
      - sensor.back_garage_door_power
      - sensor.bed2_climate_humidity
      - sensor.bed2_climate_power
      - sensor.bed2_climate_temperature
      - sensor.bed2_ens_climate_humidity
      - sensor.bed2_ens_climate_power
      - sensor.bed2_ens_climate_temperature
      - sensor.bed2_remote_power
      - sensor.bed3_climate_humidity
      - sensor.bed3_climate_power
      - sensor.bed3_climate_temperature
      - sensor.bed3_ens_climate_humidity
      - sensor.bed3_ens_climate_power
      - sensor.bed3_ens_climate_temperature
      - sensor.bed3_remote_power
      - sensor.bed4_climate_humidity
      - sensor.bed4_climate_power
      - sensor.bed4_climate_temperature
      - sensor.bed4_ens_climate_humidity
      - sensor.bed4_ens_climate_power
      - sensor.bed4_ens_climate_temperature
      - sensor.bed4_motion_power
      - sensor.beerburrum_gust_speed_kilometre
      - sensor.beerburrum_humidity
      - sensor.beerburrum_temp
      - sensor.beerburrum_temp_feels_like
      - sensor.beerburrum_wind_direction
      - sensor.beerburrum_wind_speed_kilometre
      - sensor.bells_creek_fire_danger_0
      - sensor.bells_creek_rain_amount_max_0
      - sensor.bells_creek_rain_amount_min_0
      - sensor.bells_creek_rain_amount_range_0
      - sensor.bells_creek_rain_chance_0
      - sensor.bells_creek_short_text_0
      - sensor.bells_creek_temp_max_0
      - sensor.bells_creek_temp_min_0
      - sensor.bells_creek_uv_category_0
      - sensor.bells_creek_uv_max_index_0
      - sensor.brad_s_phone_geocoded_location
      - sensor.brad_s_phone_pressure_sensor
      - sensor.brad_s_phone_wifi_connection
      - sensor.cash_factor_fronius_logger_info
      - sensor.check_home_assistant_configuration_newest_version
      - sensor.check_home_assistant_configuration_version
      - sensor.civil_daylight
      - sensor.civil_night
      - sensor.co2_factor_fronius_logger_info
      - sensor.current_ac_fronius_inverter
      - sensor.current_dc_fronius_inverter
      - sensor.current_pool_temperature
      - sensor.current_version
      - sensor.dawn
      - sensor.daylight
      - sensor.delivery_factor_fronius_logger_info
      - sensor.dining_climate_humidity
      - sensor.dining_climate_power
      - sensor.dining_climate_temperature
      - sensor.dining_sliding_door_power
      - sensor.dishwasher_plug_electrical_usage_wattage
      - sensor.dishwasher_plug_power
      - sensor.dishwasher_plug_temperature
      - sensor.dog_door_power
      - sensor.dryer_current_course
      - sensor.dryer_dry_level
      - sensor.dryer_error_message
      - sensor.dryer_plug_electrical_usage_wattage
      - sensor.dryer_plug_temperature
      - sensor.dryer_process_state
      - sensor.dryer_run_state
      - sensor.dryer_status
      - sensor.dusk
      - sensor.elevation
      - sensor.energy_day_fronius
      - sensor.energy_total_fronius
      - sensor.energy_year_fronius
      - sensor.entryway_climate_humidity
      - sensor.entryway_climate_power
      - sensor.entryway_climate_temperature
      - sensor.envestnet_inc_stock
      - sensor.error_code_fronius_inverter
      - sensor.frequency_ac_fronius_inverter
      - sensor.fronius_day_energy_kwh
      - sensor.fronius_total_energy_mwh
      - sensor.fronius_yearly_energy_kwh
      - sensor.front_door_power
      - sensor.g_and_t_climate_humidity
      - sensor.g_and_t_climate_power
      - sensor.g_and_t_climate_temperature
      - sensor.galley_kitchen_climate_humidity
      - sensor.galley_kitchen_climate_power
      - sensor.galley_kitchen_climate_temperature
      - sensor.galley_kitchen_motion_power
      - sensor.garage_left_motion_power
      - sensor.garage_nook_motion_power
      - sensor.hacs
      - sensor.home_assistant_operating_system_newest_version
      - sensor.home_assistant_operating_system_version
      - sensor.home_assistant_v2_db
      - sensor.internal_garage_door_power
      - sensor.inverter_utilisation
      - sensor.kitchen_climate_display_humidity
      - sensor.kitchen_climate_display_power
      - sensor.kitchen_climate_display_temperature
      - sensor.kitchen_climate_humidity
      - sensor.kitchen_climate_power
      - sensor.kitchen_climate_temperature
      - sensor.kitchen_fridge_plug_electrical_measurement
      - sensor.kitchen_fridge_plug_electrical_usage
      - sensor.kitchen_motion_power
      - sensor.kitchen_sink_water_power
      - sensor.kitchen_sink_water_temperature
      - sensor.laundry_climate_humidity
      - sensor.laundry_climate_power
      - sensor.laundry_climate_temperature
      - sensor.laundry_door_power
      - sensor.laundry_fridge_plug_electrical_measurement
      - sensor.laundry_fridge_plug_electrical_usage
      - sensor.laundry_motion_power
      - sensor.laundry_sink_water_power
      - sensor.led_color_fronius_inverter
      - sensor.led_state_fronius_inverter
      - sensor.lighting_strikes_lightning_azimuth
      - sensor.lighting_strikes_lightning_counter
      - sensor.lighting_strikes_lightning_distance
      - sensor.linen_room_door_power
      - sensor.linen_room_motion_power
      - sensor.lumi_lumi_plug_35d63802_analog_input
      - sensor.lumi_lumi_plug_35d63802_analog_input_2
      - sensor.lumi_lumi_plug_35d63802_electrical_measurement_apparent_power
      - sensor.lumi_lumi_plug_35d63802_electrical_measurement_rms_current
      - sensor.lumi_lumi_plug_35d63802_electrical_measurement_rms_voltage
      - sensor.lumi_lumi_plug_a0342d03_analog_input_2
      - sensor.lumi_lumi_plug_a0342d03_electrical_measurement_apparent_power
      - sensor.lumi_lumi_plug_a0342d03_electrical_measurement_rms_current
      - sensor.lumi_lumi_plug_analog_input
      - sensor.lumi_lumi_plug_analog_input_2
      - sensor.lumi_lumi_plug_electrical_measurement_apparent_power
      - sensor.lumi_lumi_plug_electrical_measurement_rms_current
      - sensor.lumi_lumi_plug_electrical_measurement_rms_voltage
      - sensor.make_up_table_plug_electrical_measurement
      - sensor.make_up_table_plug_electrical_usage
      - sensor.master_bedroom_balcony_door_power
      - sensor.master_bedroom_climate_humidity
      - sensor.master_bedroom_climate_power
      - sensor.master_bedroom_climate_temperature
      - sensor.master_ens_climate_humidity
      - sensor.master_ens_climate_power
      - sensor.master_ens_climate_temperature
      - sensor.master_shower_motion_sensor_power
      - sensor.master_wir_motion_power
      - sensor.max_elevation
      - sensor.media_climate_humidity
      - sensor.media_climate_power
      - sensor.media_climate_temperature
      - sensor.media_sliding_door_power
      - sensor.meter_mode_fronius_power_flow
      - sensor.min_elevation
      - sensor.nautical_dawn
      - sensor.nautical_daylight
      - sensor.nautical_dusk
      - sensor.nautical_night
      - sensor.nbn_billing_cycle_length
      - sensor.nbn_billing_cycle_remaining
      - sensor.nbn_data_used
      - sensor.nbn_downloaded
      - sensor.nbn_uploaded
      - sensor.night
      - sensor.office_formaldehyde_level
      - sensor.office_multi_climate_carbon_dioxide_concentration
      - sensor.office_multi_climate_formaldehyde_concentration
      - sensor.office_multi_climate_humidity
      - sensor.office_multi_climate_temperature
      - sensor.office_multi_climate_voc_level
      - sensor.openweathermap_cloud_coverage
      - sensor.openweathermap_condition
      - sensor.openweathermap_dew_point
      - sensor.openweathermap_feels_like_temperature
      - sensor.openweathermap_forecast_cloud_coverage
      - sensor.openweathermap_forecast_condition
      - sensor.openweathermap_forecast_precipitation
      - sensor.openweathermap_forecast_precipitation_probability
      - sensor.openweathermap_forecast_pressure
      - sensor.openweathermap_forecast_temperature
      - sensor.openweathermap_forecast_temperature_low
      - sensor.openweathermap_forecast_time
      - sensor.openweathermap_forecast_wind_bearing
      - sensor.openweathermap_forecast_wind_speed
      - sensor.openweathermap_humidity
      - sensor.openweathermap_precipitation_kind
      - sensor.openweathermap_pressure
      - sensor.openweathermap_rain
      - sensor.openweathermap_snow
      - sensor.openweathermap_temperature
      - sensor.openweathermap_uv_index
      - sensor.openweathermap_weather
      - sensor.openweathermap_weather_code
      - sensor.openweathermap_wind_bearing
      - sensor.openweathermap_wind_speed
      - sensor.plex_the_hampton_s_plex
      - sensor.powder_room_motion_power
      - sensor.power_ac_fronius_inverter
      - sensor.project_zero_three_diesel
      - sensor.project_zero_three_e10
      - sensor.project_zero_three_lpg
      - sensor.project_zero_three_u91
      - sensor.project_zero_three_u95
      - sensor.project_zero_three_u98
      - sensor.pure_current_clean_area
      - sensor.pure_current_clean_duration
      - sensor.pure_dnd_end
      - sensor.pure_dnd_start
      - sensor.pure_filter_left
      - sensor.pure_last_clean_area
      - sensor.pure_last_clean_duration
      - sensor.pure_last_clean_end
      - sensor.pure_last_clean_start
      - sensor.pure_main_brush_left
      - sensor.pure_sensor_dirty_left
      - sensor.pure_side_brush_left
      - sensor.pure_total_clean_area
      - sensor.pure_total_clean_count
      - sensor.pure_total_duration
      - sensor.s5_current_clean_area
      - sensor.s5_current_clean_duration
      - sensor.s5_dnd_end
      - sensor.s5_dnd_start
      - sensor.s5_filter_left
      - sensor.s5_last_clean_area
      - sensor.s5_last_clean_duration
      - sensor.s5_last_clean_end
      - sensor.s5_last_clean_start
      - sensor.s5_main_brush_left
      - sensor.s5_sensor_dirty_left
      - sensor.s5_side_brush_left
      - sensor.s5_total_clean_area
      - sensor.s5_total_clean_count
      - sensor.s5_total_duration
      - sensor.sally_cres_sunrise
      - sensor.sally_cres_sunset
      - sensor.samsung_fold_battery_health
      - sensor.samsung_fold_battery_level
      - sensor.samsung_fold_battery_state
      - sensor.samsung_fold_battery_temperature
      - sensor.samsung_fold_charger_type
      - sensor.samsung_fold_detected_activity
      - sensor.samsung_fold_geocoded_location
      - sensor.samsung_fold_pressure_sensor
      - sensor.samsung_fold_proximity_sensor
      - sensor.samsung_fold_sleep_confidence
      - sensor.samsung_fold_sleep_segment
      - sensor.samsung_fold_steps_sensor
      - sensor.seasons
      - sensor.set_pool_temperature
      - sensor.solar_midnight
      - sensor.solar_noon
      - sensor.stairs_climate_power
      - sensor.stairs_humidity
      - sensor.stairs_motion_power
      - sensor.stairs_temperature
      - sensor.status_code_fronius_inverter
      - sensor.studio_code_server_cpu_percent
      - sensor.studio_code_server_memory_percent
      - sensor.studio_code_server_newest_version
      - sensor.studio_code_server_version
      - sensor.sunrise
      - sensor.sunset
      - sensor.sunset_patio_door_power
      - sensor.terminal_ssh_cpu_percent
      - sensor.terminal_ssh_memory_percent
      - sensor.terminal_ssh_newest_version
      - sensor.terminal_ssh_version
      - sensor.the_hampton_s_plex_library_movies
      - sensor.the_hampton_s_plex_library_tv_shows
      - sensor.upstairs_lounge_climate_humidity
      - sensor.upstairs_lounge_climate_power
      - sensor.upstairs_lounge_climate_temperature
      - sensor.void_lounge_climate_humidity
      - sensor.void_lounge_climate_power
      - sensor.void_lounge_climate_temperature
      - sensor.void_lounge_door_power
      - sensor.voltage_dc_fronius_inverter
      - sensor.washing_machine_current_course
      - sensor.washing_machine_error_message
      - sensor.washing_machine_plug_temperature
      - sensor.washing_machine_plug_wattage
      - sensor.washing_machine_run_state
      - sensor.washing_machine_spin_speed
      - sensor.washing_machine_status
      - sensor.washing_machine_water_temp
      - sun.sun
      - switch.aarlo_all_sirens
      - switch.aarlo_siren_dog_hotel_camera
      - switch.aarlo_siren_driveway_left_camera
      - switch.aarlo_siren_driveway_right_camera
      - switch.aarlo_siren_front_yard_camera
      - switch.aarlo_siren_laundry_courtyard_camera
      - switch.aarlo_siren_pool_camera_4k
      - switch.aarlo_snapshot_dog_hotel_camera
      - switch.aarlo_snapshot_driveway_left_camera
      - switch.aarlo_snapshot_driveway_right_camera
      - switch.aarlo_snapshot_front_yard_camera
      - switch.aarlo_snapshot_laundry_courtyard_camera
      - switch.aarlo_snapshot_pool_camera_4k
      - switch.aarlo_snapshot_video_doorbell
      - switch.diffuser_toggle
      - switch.dishwasher_plug_switch
      - switch.dryer_plug_switch
      - switch.dryer_power_off
      - switch.electric_towel_heater_switch
      - switch.garage_door_opener
      - switch.kitchen_fridge_plug_switch
      - switch.laundry_fridge_plug_switch
      - switch.make_up_table_plug_switch
      - switch.no_name_group_0x0000_zha_group_0x0000
      - switch.plug_usb_1_switch
      - switch.plug_usb_2_switch
      - switch.plug_usb_3_switch
      - switch.pool_heater_switch
      - switch.quad_board_2_garage_on_off
      - switch.sonos_dining_room_sonos_5_crossfade
      - switch.sonos_void_room_sonos_5_crossfade
      - switch.tz3000_o005nuxx_ts011f_10cc03fe_on_off_2
      - switch.tz3000_o005nuxx_ts011f_10cc03fe_on_off_3
      - switch.tz3000_o005nuxx_ts011f_10cc03fe_on_off_4
      - switch.tz3000_o005nuxx_ts011f_10cc03fe_on_off_5
      - switch.tz3000_o005nuxx_ts011f_99cc03fe_on_off
      - switch.tz3000_o005nuxx_ts011f_99cc03fe_on_off_2
      - switch.tz3000_o005nuxx_ts011f_99cc03fe_on_off_3
      - switch.tz3000_o005nuxx_ts011f_99cc03fe_on_off_4
      - switch.tz3000_o005nuxx_ts011f_99cc03fe_on_off_5
      - switch.void_curtains
      - switch.washing_machine_plug_switch
      - switch.washing_machine_power_off
      - timer.ac_timer
      - timer.lights_timer
      - timer.pool_pump
      - vacuum.pure_s6_vacuum
      - vacuum.s5
      - weather.bells_creek_hourly
      - weather.bells_creek_weather
      - weather.openweathermap
      - zone.brads_parents_home
      - zone.bunnings_caloundra
      - zone.home
      - zone.the_golden_hour
      - zone.upyourself_training

yeah i think ill do the same then re add the ones i want to include.

Im going to move to a dedicated NUC or just attached an ssd harddrove to my pi4

Yes, your exclusion list is longer than mine. It should help a lot.

I don’t think Logger exclusions would help. The documentation implies that you can exclude things from Logger separately from excluding them from Recorder. But it also implies that Logger uses the data that Recorder records. Looking at the database, I don’t see any Logger data. So I don’t think excluding anything from Logger after already excluding from Recorder is going to make any difference. If someone has more information, I’d love to hear it.

yeah ok thought so, i guess its just waiting now
right now im this

Disk Total 29.0 GB
Disk Used 27.6 GB

I’m not as patient as you. I’d go into Developer Tools / Services and purge some entities right away.

Plus, purging (including the daily purge based on your purge_keep_days) doesn’t do a repack. The Recorder: Purge service can, but the UI is a little confusing. You have to select the check box on the left and turn on the slider on the right. A repack is the only way to reduce the database size.

how do you know if its worked??
this is what i have selected?

well my Statistics is now showing im not recording on alot of entities now, so thats a start.

im trying to see if i ahve done a repack, but cant see my file size changing

you have to click the toggle switch for Repack also, for it to work
and if you then click call service, and go to see your DB size … and you can sleep well again :slight_smile:

use supervisor to install mariadb

add one line to your configuration.yaml

Nah that didn’t work. I must have recorder not working correctly.

So I need to remove default config from.yaml?

i cant, it says i dont have enough space :frowning:

hey guys, im struggling here. I have followed the document on how to purge, but i dont think its doing anything

Suggestions please??

If you did click the “toggle” to the right, under days, and Unchecked “Days to keep” … then clicked “call service” ( only for Repack Service ), if that don’t work, i guess thats also because you have to little diskspace/memory to handle such a big Task/DB,
… i would “move” ALL Backup-files from disk, and/or starting to “Recorder Purge Entities” … 1 by 1 , your not only running out of disk now, but also time !
… If you don’t mind your “History/Statistics” just delete" the DB-file

Right now I don’t care about my stats

So how do I delete the database?

You delete it either via Samba, a ssh console, or maybe via file-editor