callacomp
December 11, 2020, 5:31pm
1
I’m running a rasp 3+ with an SSD and I’ve recently been suffering with HA disappearing. I thought it could power so installed RPi Power status and now and again it came up with issues, now have official power supply and thats gone away. Someone else then suggested low power on external SSD, even though I had a powered hub. I now have a Y cable attached to the Pi and a 2.4amp external supply. Still disappears. It’s not hot, plenty of disk space, using MariaDB, using ZWave and C2531 Zigbee USB through powered hub.
This is the screen when I remove cables
This is the part of the log file during the issue, I’ve removed some of it to keep it smallish
Don’t know what else to try. Bluetooth errors are common but I also notice CPU: 1 PID: 1223 Comm: udevd Tainted: G
Any suggestions?
09:52:07 73977.148593 Bluetooth: hci0: Frame reassembly failed (-84)
09:52:07 73977.187818 Bluetooth: hci0: Frame reassembly failed (-84)
09:53:10 74040.411316 udevd invoked oom-killer: gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=-1000
09:53:10 74040.415055 udevd cpuset=a8d5584ffb79ba9df18a64e0f6d8ede22fe4dc930b7f5244366431efbacfe517 mems_allowed=0
09:53:10 74040.418721 CPU: 1 PID: 1223 Comm: udevd Tainted: G C 4.19.127-v7 #1
09:53:10 74040.422208 Hardware name: BCM2835
09:53:10 74040.425757 <8010d4f8>] (show_stack+0x20/0x24)
09:53:10 74040.429477 <80972b7c>] (dump_stack+0xd4/0x118)
09:53:10 74040.433269 <80274884>] (dump_header+0x80/0x270)
09:53:10 74040.437136 <802739f4>] (oom_kill_process+0xe8/0x38c)
09:53:10 74040.440888 <8027466c>] (out_of_memory+0x280/0x380)
09:53:10 74040.444861 <8027a4d4>] (__alloc_pages_nodemask+0xb90/0x111c)
09:53:10 74040.448834 <8026fc14>] (filemap_fault+0x54c/0x70c)
09:53:10 74040.452748 <803b31a4>] (ext4_filemap_fault+0x38/0x4c)
09:53:10 74040.456489 <802a8e18>] (__do_fault+0x60/0x188)
09:53:10 74040.460482 <802ad9f0>] (handle_mm_fault+0x850/0xd30)
09:53:10 74040.464483 <8098ee3c>] (do_page_fault+0x154/0x3a0)
09:53:10 74040.468471 <801169f0>] (do_PrefetchAbort+0x5c/0xec)
09:53:10 74040.472322 <80101f24>] (ret_from_exception+0x0/0x1c)
09:53:10 74040.476080 Exception stack(0xaad9bfb0 to 0xaad9bff8)
09:53:10 74040.479595 bfa0: 00000006 00000000 00000006 76e80685
09:53:10 74040.483030 bfc0: 76e808e0 76e80680 76e80870 00000000 00000000 02250394 00000069 00000000
09:53:10 74040.486521 bfe0: 76f44f8c 7ee56508 76f01143 76ee1834 00000030 ffffffff
09:53:10 74040.490106 Mem-Info:
09:53:10 74040.493934 active_anon:86376 inactive_anon:87205 isolated_anon:0
09:53:10 74040.493934 active_file:344 inactive_file:546 isolated_file:0
09:53:10 74040.493934 unevictable:0 dirty:0 writeback:0 unstable:0
09:53:10 74040.493934 slab_reclaimable:10597 slab_unreclaimable:18663
09:53:10 74040.493934 mapped:258 shmem:619 pagetables:2733 bounce:0
09:53:10 74040.493934 free:1513 free_pcp:122 free_cma:0
09:53:11 74040.518389 Node 0 active_anon:345504kB inactive_anon:348820kB active_file:1376kB inactive_file:2884kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:1232kB dirty:0kB writeback:0kB shmem:2476kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
09:53:11 74040.527652 Normal free:4816kB min:3868kB low:4832kB high:5796kB active_anon:345504kB inactive_anon:348820kB active_file:1308kB inactive_file:3104kB unevictable:0kB writepending:0kB present:970752kB managed:946152kB mlocked:0kB kernel_stack:6096kB pagetables:10932kB bounce:0kB free_pcp:316kB local_pcp:0kB free_cma:0kB
09:53:11 74040.542311 lowmem_reserve
09:53:11 74040.547294 Normal: 475*4kB (UMEH) 120*8kB (UMEH) 41*16kB (UH) 2*32kB (H) 5*64kB (H) 0*128kB 1*256kB (H) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4156kB
09:53:11 74040.558598 2406 total pagecache pages
09:53:11 74040.564592 275 pages in swap cache
09:53:11 74040.570604 Swap cache stats: add 78682, delete 78407, find 332018/344127
09:53:11 74040.576647 Free swap = 0kB
09:53:11 74040.583376 Total swap = 236536kB
09:53:11 74040.589430 242688 pages RAM
09:53:11 74040.595524 0 pages HighMem/MovableOnly
09:53:11 74040.601540 6150 pages reserved
09:53:11 74040.607296 2048 pages cma reserved
09:53:11 74040.613281 Tasks state (memory values in pages):
09:53:11 74040.619221 [ pid uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
09:53:11 74040.625110 [ 108 0 108 60173 124 204800 8 -250 systemd-journal
09:53:11 74040.631192 [ 125 0 125 2104 149 16384 26 -1000 systemd-udevd
09:53:11 74040.637226 [ 243 1008 243 4085 67 18432 18 0 systemd-timesyn
09:53:11 74040.643233 [ 248 0 248 521 12 10240 1 0 avahi-dnsconfd
09:53:11 74040.649302 [ 251 1002 251 1278 121 14336 25 -900 dbus-daemon
09:53:11 74041.464543 Out of memory: Kill process 9356 (python3) score 347 or sacrifice child
09:53:11 74041.469021 Killed process 9356 (python3) total-vm:629824kB, anon-rss:394676kB, file-rss:0kB, shmem-rss:0kB
09:53:12 74041.631937 oom_reaper: reaped process 9356 (python3), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
09:53:16 74046.279602 audit: type=1701 audit(1607593996.071:311): auid=4294967295 uid=0 gid=0 ses=4294967295 subj==unconfined pid=108 comm="systemd-journal" exe="/usr/lib/systemd/systemd-journald" sig=6 res=1
09:53:16 74046.442756 systemd
09:53:16 74046.448557 systemd-coredump
09:53:16 74046.463960 systemd
09:53:16 74046.470064 systemd
09:53:16 74046.489762 systemd
09:53:17 74046.500721 systemd
09:53:17 74046.542570 systemd
09:53:17 74046.548777 systemd
09:53:17 74046.561537 systemd
09:53:17 74046.567449 systemd
09:53:17 74046.586344 systemd
09:53:17 74046.620011 IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
09:53:17 74046.625626 brcmfmac: brcmf_cfg80211_set_power_mgmt: power save enabled
09:53:17 74046.626676 audit: type=1305 audit(1607593996.411:312): audit_enabled=1 old=1 auid=4294967295 ses=4294967295 subj==unconfined res=1
09:53:17 74046.785447 systemd-journald
09:53:17 74047.318355 IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
callacomp
December 12, 2020, 9:58am
2
and again last night, full log below. in two halves
[234883.314380] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
[234883.319030] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save enabled
[235199.322401] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
[235199.326899] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save enabled
[235515.350434] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
[235515.355593] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save enabled
[235831.357398] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
[235831.363668] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save enabled
[239176.052651] audit: type=1701 audit(1607759124.599:403): auid=4294967295 uid=0 gid=0 ses=4294967295 subj==unconfined pid=12318 comm="systemd-journal" exe="/usr/lib/systemd/systemd-journald" sig=6 res=1
[245267.281700] hass-configurat invoked oom-killer: gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0
[245267.286728] hass-configurat cpuset=3c1ee3adf37ae65456a58d8e7f4d01b9b258e2887a228f204b80350d2611d549 mems_allowed=0
[245267.291598] CPU: 2 PID: 13066 Comm: hass-configurat Tainted: G C 4.19.127-v7 #1
[245267.296572] Hardware name: BCM2835
[245267.301424] [<801122a8>] (unwind_backtrace) from [<8010d4f8>] (show_stack+0x20/0x24)
[245267.306279] [<8010d4f8>] (show_stack) from [<80972b7c>] (dump_stack+0xd4/0x118)
[245267.311135] [<80972b7c>] (dump_stack) from [<80274884>] (dump_header+0x80/0x270)
[245267.316012] [<80274884>] (dump_header) from [<802739f4>] (oom_kill_process+0xe8/0x38c)
[245267.320894] [<802739f4>] (oom_kill_process) from [<8027466c>] (out_of_memory+0x280/0x380)
[245267.325686] [<8027466c>] (out_of_memory) from [<8027a4d4>] (__alloc_pages_nodemask+0xb90/0x111c)
[245267.330700] [<8027a4d4>] (__alloc_pages_nodemask) from [<8026fc14>] (filemap_fault+0x54c/0x70c)
[245267.335736] [<8026fc14>] (filemap_fault) from [<803b31a4>] (ext4_filemap_fault+0x38/0x4c)
[245267.340669] [<803b31a4>] (ext4_filemap_fault) from [<802a8e18>] (__do_fault+0x60/0x188)
[245267.345965] [<802a8e18>] (__do_fault) from [<802ad9f0>] (handle_mm_fault+0x850/0xd30)
[245267.351225] [<802ad9f0>] (handle_mm_fault) from [<8098ee3c>] (do_page_fault+0x154/0x3a0)
[245267.356286] [<8098ee3c>] (do_page_fault) from [<801169f0>] (do_PrefetchAbort+0x5c/0xec)
[245267.361425] [<801169f0>] (do_PrefetchAbort) from [<80101f24>] (ret_from_exception+0x0/0x1c)
[245267.366620] Exception stack(0xb4cbdfb0 to 0xb4cbdff8)
[245267.371702] dfa0: 76dd4372 766e3e00 00000000 00000000
[245267.376902] dfc0: 76162028 76162174 761d8250 00005073 00000050 766e3e28 76f0a4b8 00000073
[245267.382293] dfe0: 76dd4373 7eba1520 76ee75d4 76dd4372 60000030 ffffffff
[245267.388136] Mem-Info:
[245267.393833] active_anon:85157 inactive_anon:86815 isolated_anon:0
[245267.393833] active_file:101 inactive_file:118 isolated_file:15
[245267.393833] unevictable:0 dirty:0 writeback:0 unstable:0
[245267.393833] slab_reclaimable:11938 slab_unreclaimable:19698
[245267.393833] mapped:42 shmem:29 pagetables:3271 bounce:0
[245267.393833] free:940 free_pcp:124 free_cma:2
[245267.426638] Node 0 active_anon:340628kB inactive_anon:347260kB active_file:332kB inactive_file:432kB unevictable:0kB isolated(anon):0kB isolated(file):28kB mapped:128kB dirty:0kB writeback:0kB shmem:116kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[245267.438185] Normal free:3756kB min:3868kB low:4832kB high:5796kB active_anon:340628kB inactive_anon:347260kB active_file:332kB inactive_file:452kB unevictable:0kB writepending:0kB present:970752kB managed:946152kB mlocked:0kB kernel_stack:6656kB pagetables:13084kB bounce:0kB free_pcp:500kB local_pcp:248kB free_cma:8kB
[245267.455624] lowmem_reserve[]: 0 0
[245267.461416] Normal: 71*4kB (UMEC) 177*8kB (UM) 123*16kB (UE) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3668kB
[245267.467646] 1200 total pagecache pages
[245267.473893] 954 pages in swap cache
[245267.480090] Swap cache stats: add 199928, delete 198974, find 1465487/1544385
[245267.486314] Free swap = 0kB
[245267.492305] Total swap = 236536kB
[245267.498400] 242688 pages RAM
[245267.504408] 0 pages HighMem/MovableOnly
[245267.510175] 6150 pages reserved
[245267.516058] 2048 pages cma reserved
[245267.521847] Tasks state (memory values in pages):
[245267.527581] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[245267.533653] [ 125] 0 125 2104 41 16384 144 -1000 systemd-udevd
[245267.539475] [ 248] 0 248 521 0 10240 17 0 avahi-dnsconfd
[245267.545523] [ 251] 1002 251 1278 125 14336 25 -900 dbus-daemon
[245267.551608] [ 255] 0 255 18814 364 51200 118 0 NetworkManager
[245267.557373] [ 264] 0 264 9460 2 30720 171 0 rauc
[245267.563256] [ 266] 0 266 10020 0 20480 65 0 rngd
[245267.569011] [ 271] 0 271 2048 71 18432 63 0 wpa_supplicant
[245267.574622] [ 315] 0 315 455 10 10240 12 0 hciattach
[245267.580356] [ 317] 0 317 1602 43 14336 24 0 bluetoothd
[245267.586176] [ 344] 1000 344 1387 71 12288 31 0 avahi-daemon
[245267.591811] [ 345] 0 345 257899 3625 143360 1077 -500 dockerd
[245267.597517] [ 346] 1000 346 1322 6 12288 49 0 avahi-daemon
[245267.603214] [ 355] 0 355 274987 1378 131072 387 -500 containerd
[245267.608579] [ 887] 0 887 231096 815 86016 339 0 docker
[245267.614173] [ 890] 0 890 732 0 10240 53 0 login
[245267.619722] [ 953] 0 953 220611 140 49152 78 -999 containerd-shim
[245267.625264] [ 970] 0 970 50 0 8192 5 0 s6-svscan
[245267.630913] [ 1054] 0 1054 50 0 8192 3 0 s6-supervise
[245267.636654] [ 1223] 0 1223 881 2 8192 184 -1000 udevd
[245267.642316] [ 1282] 0 1282 50 0 8192 3 0 s6-supervise
[245267.648119] [ 1283] 0 1283 50 0 8192 3 0 s6-supervise
[245267.653711] [ 1286] 0 1286 29723 10555 126976 3414 0 python3
[245267.659035] [ 1287] 0 1287 703 83 10240 220 0 bash
[245267.664418] [ 1579] 0 1579 220435 171 49152 78 -999 containerd-shim
[245267.669787] [ 1596] 0 1596 50 0 8192 5 0 s6-svscan
[245267.675024] [ 1677] 0 1677 50 0 8192 3 0 s6-supervise
[245267.680343] [ 1835] 0 1835 222484 177 40960 80 -999 containerd-shim
[245267.685510] [ 1853] 0 1853 50 0 6144 5 0 s6-svscan
[245267.690169] [ 1874] 0 1874 50 0 8192 3 0 s6-supervise
[245267.695111] [ 1878] 0 1878 207440 2084 59392 325 0 coredns
[245267.699872] [ 1979] 0 1979 50 0 6144 3 0 s6-supervise
[245267.704536] [ 2244] 0 2244 220611 143 49152 115 -999 containerd-shim
[245267.709147] [ 2278] 0 2278 50 0 6144 5 0 s6-svscan
[245267.714048] [ 2415] 0 2415 46 0 4096 5 0 foreground
[245267.718937] [ 2417] 0 2417 50 0 6144 3 0 s6-supervise
[245267.723736] [ 2429] 0 2429 45 0 4096 3 0 foreground
[245267.728683] [ 2589] 0 2589 323 0 6144 8 0 sleep
[245267.733630] [ 2626] 0 2626 220435 121 47104 77 -999 containerd-shim
[245267.738441] [ 2651] 0 2651 50 0 6144 3 0 s6-svscan
[245267.743245] [ 2713] 0 2713 50 1 8192 0 0 s6-supervise
[245267.748071] [ 2912] 0 2912 50 0 8192 3 0 s6-supervise
[245267.752828] [ 2915] 0 2915 178 9 10240 1 0 mdns-repeater
[245267.757333] [ 2962] 0 2962 1903 90 14336 140 -1000 udevd
[245267.762083] [ 2986] 0 2986 50 0 8192 3 0 s6-supervise
[245267.766786] [ 2988] 0 2988 20015 126 24576 222 0 pulseaudio
[245267.771525] [ 3043] 0 3043 210796 0 34816 118 -500 docker-proxy
[245267.776252] [ 3055] 0 3055 215406 0 43008 127 -500 docker-proxy
[245267.781048] [ 3069] 0 3069 213101 0 38912 125 -500 docker-proxy
[245267.785840] [ 3082] 0 3082 213101 0 38912 123 -500 docker-proxy
[245267.790260] [ 3090] 0 3090 220435 170 47104 80 -999 containerd-shim
[245267.794951] [ 3106] 0 3106 179 4 8192 4 0 docker-init
[245267.799576] [ 3158] 0 3158 679 2 10240 283 0 bash
[245267.804203] [ 3173] 0 3173 215406 0 36864 120 -500 docker-proxy
[245267.808602] [ 3182] 0 3182 220611 159 49152 82 -999 containerd-shim
[245267.813237] [ 3199] 0 3199 50 0 8192 5 0 s6-svscan
callacomp
December 12, 2020, 9:58am
3
[245267.817782] [ 3285] 0 3285 50 0 8192 3 0 s6-supervise
[245267.822256] [ 3576] 0 3576 208491 0 28672 98 -500 docker-proxy
[245267.826743] [ 3655] 0 3655 220435 162 47104 86 -999 containerd-shim
[245267.831344] [ 3711] 0 3711 50 0 8192 5 0 s6-svscan
[245267.836081] [ 4255] 0 4255 50 0 6144 3 0 s6-supervise
[245267.840579] [ 4527] 0 4527 50 0 8192 3 0 s6-supervise
[245267.845267] [ 4531] 0 4531 1641 2 12288 264 0 bash
[245267.849853] [ 4633] 0 4633 823 12 10240 44 0 socat
[245267.854415] [ 4634] 0 4634 8052 620 40960 6581 0 mosquitto
[245267.858834] [ 4656] 0 4656 1429 2 12288 81 0 mysqld_safe
[245267.863418] [ 5194] 0 5194 98781 31753 239616 6037 0 mysqld
[245267.867930] [ 6578] 0 6578 220435 121 49152 71 -999 containerd-shim
[245267.872452] [ 6596] 0 6596 50 0 8192 5 0 s6-svscan
[245267.876996] [ 6644] 0 6644 50 0 8192 3 0 s6-supervise
[245267.881616] [ 6858] 0 6858 215406 0 40960 124 -500 docker-proxy
[245267.886169] [ 6866] 0 6866 220435 120 43008 85 -999 containerd-shim
[245267.890539] [ 6888] 0 6888 50 3 6144 2 0 s6-svscan
[245267.895160] [ 7010] 0 7010 50 0 8192 3 0 s6-supervise
[245267.899710] [ 7681] 0 7681 50 0 6144 3 0 s6-supervise
[245267.904347] [ 7682] 0 7682 50 0 8192 3 0 s6-supervise
[245267.908682] [ 7684] 0 7684 3916 10 24576 3124 0 ttyd
[245267.913184] [ 7688] 0 7688 755 20 10240 59 0 sshd
[245267.917616] [ 7852] 0 7852 222660 173 47104 79 -999 containerd-shim
[245267.922129] [ 7923] 0 7923 179 3 8192 5 0 docker-init
[245267.926731] [ 8020] 0 8020 50 0 8192 3 0 s6-supervise
[245267.931409] [ 8022] 0 8022 50 0 6144 3 0 s6-supervise
[245267.935987] [ 8023] 0 8023 5501 95 32768 205 0 nmbd
[245267.940315] [ 8025] 0 8025 8443 49 40960 361 0 smbd
[245267.944877] [ 8061] 0 8061 50 0 8192 5 0 s6-svscan
[245267.949284] [ 8088] 0 8088 7991 21 38912 361 0 smbd-notifyd
[245267.953817] [ 8089] 0 8089 7992 42 38912 340 0 cleanupd
[245267.958107] [ 8095] 0 8095 46 0 4096 5 0 foreground
[245267.962657] [ 8096] 0 8096 50 0 6144 3 0 s6-supervise
[245267.967112] [ 8107] 0 8107 45 0 4096 3 0 foreground
[245267.971475] [ 8259] 0 8259 740 113 12288 225 0 bash
[245267.975757] [ 8267] 0 8267 220435 174 49152 77 -999 containerd-shim
[245267.980125] [ 8298] 0 8298 50 0 8192 6 0 s6-svscan
[245267.984600] [ 8319] 0 8319 50 0 6144 3 0 s6-supervise
[245267.988866] [ 8320] 0 8320 50 0 8192 3 0 s6-supervise
[245267.993121] [ 8322] 0 8322 11361 10 24576 428 0 php-fpm7
[245267.997433] [ 8323] 0 8323 1008 0 10240 122 0 nginx
[245268.001733] [ 8395] 0 8395 50 0 6144 3 0 s6-supervise
[245268.005892] [ 8447] 100 8447 11366 0 20480 441 0 php-fpm7
[245268.010094] [ 8448] 100 8448 11366 0 20480 440 0 php-fpm7
[245268.014378] [ 8449] 100 8449 11366 0 20480 440 0 php-fpm7
[245268.018534] [ 8598] 100 8598 1070 0 10240 181 0 nginx
[245268.022676] [ 10454] 0 10454 50 0 6144 3 0 s6-supervise
[245268.026893] [ 10455] 0 10455 50 0 6144 3 0 s6-supervise
[245268.031059] [ 10456] 0 10456 203310 2279 61440 1049 0 AdGuardHome
[245268.035258] [ 10457] 0 10457 1252 0 14336 146 0 nginx
[245268.039223] [ 10929] 0 10929 1320 41 14336 176 0 nginx
[245268.043233] [ 12792] 0 12792 222484 155 49152 84 -999 containerd-shim
[245268.047308] [ 12809] 0 12809 50 0 8192 5 0 s6-svscan
[245268.051418] [ 12912] 0 12912 50 0 8192 3 0 s6-supervise
[245268.055418] [ 13062] 0 13062 50 0 8192 3 0 s6-supervise
[245268.059193] [ 13066] 0 13066 5216 84 32768 3055 0 hass-configurat
[245268.063183] [ 13424] 0 13424 220435 177 49152 82 -999 containerd-shim
[245268.067254] [ 13441] 0 13441 179 3 8192 5 0 docker-init
[245268.071370] [ 13457] 0 13457 50 0 8192 10 0 s6-svscan
[245268.075338] [ 13484] 0 13484 50 0 8192 3 0 s6-supervise
[245268.079406] [ 14416] 0 14416 50 0 8192 3 0 s6-supervise
[245268.083481] [ 14417] 0 14417 50 0 8192 3 0 s6-supervise
[245268.087330] [ 14421] 0 14421 13533 305 38912 3540 0 esphome
[245268.091035] [ 14423] 0 14423 1464 2 12288 131 0 nginx
[245268.095100] [ 14490] 0 14490 1511 0 12288 187 0 nginx
[245268.099036] [ 19512] 0 19512 715 0 12288 21 0 hassos-cli
[245268.103033] [ 19522] 0 19522 235178 792 92160 316 0 docker
[245268.106819] [ 19540] 0 19540 453 22 10240 33 0 cli.sh
[245268.110755] [ 29312] 0 29312 1881 2 14336 91 0 git
[245268.114844] [ 29815] 1008 29815 4085 63 20480 22 0 systemd-timesyn
[245268.118877] [ 1910] 0 1910 478 18 8192 99 0 tmux: server
[245268.122885] [ 1911] 0 1911 584 2 8192 187 0 bash
[245268.126962] [ 1927] 0 1927 360 0 8192 42 0 vi
[245268.130971] [ 5791] 0 5791 215406 0 40960 114 -500 docker-proxy
[245268.135040] [ 5799] 0 5799 220435 177 51200 72 -999 containerd-shim
[245268.138998] [ 5814] 0 5814 179 3 8192 5 0 docker-init
[245268.143059] [ 5870] 0 5870 50 0 8192 5 0 s6-svscan
[245268.147187] [ 5898] 0 5898 46 0 4096 5 0 foreground
[245268.151286] [ 5899] 0 5899 50 0 6144 3 0 s6-supervise
[245268.155322] [ 5910] 0 5910 45 0 4096 3 0 foreground
[245268.159308] [ 6051] 0 6051 435 2 8192 32 0 run.sh
[245268.163391] [ 6082] 0 6082 34846 6164 212992 691 0 node
[245268.167493] [ 6093] 0 6093 31601 3675 204800 696 0 node
[245268.171672] [ 6112] 0 6112 34539 2935 276480 4371 0 node
[245268.175742] [ 12318] 0 12318 98939 113 368640 3 -250 systemd-journal
[245268.179920] [ 12803] 0 12803 213101 0 40960 113 -500 docker-proxy
[245268.184403] [ 12811] 0 12811 220435 172 49152 78 -999 containerd-shim
[245268.188723] [ 12827] 0 12827 50 0 8192 5 0 s6-svscan
[245268.193069] [ 12907] 0 12907 50 0 8192 3 0 s6-supervise
[245268.197470] [ 13051] 0 13051 50 0 8192 3 0 s6-supervise
[245268.201827] [ 13053] 0 13053 200849 566 26624 460 0 observer
[245268.206014] [ 13134] 0 13134 213101 0 36864 121 -500 docker-proxy
[245268.210235] [ 13147] 0 13147 215406 0 38912 124 -500 docker-proxy
[245268.214604] [ 13155] 0 13155 220435 177 36864 75 -999 containerd-shim
[245268.218941] [ 13171] 0 13171 50 0 6144 9 0 s6-svscan
[245268.223196] [ 13252] 0 13252 50 0 8192 3 0 s6-supervise
[245268.227472] [ 13639] 0 13639 50 0 8192 3 0 s6-supervise
[245268.231744] [ 13640] 0 13640 50 0 6144 9 0 s6-supervise
[245268.235970] [ 13641] 0 13641 50 0 6144 3 0 s6-supervise
[245268.239995] [ 13642] 0 13642 50 0 8192 3 0 s6-supervise
[245268.244316] [ 13645] 0 13645 1332 507 14336 132 0 mosquitto
[245268.248498] [ 13647] 0 13647 17031 1027 59392 1304 0 ozwdaemon
[245268.252815] [ 13650] 0 13650 22561 719 43008 3063 0 websockify
[245268.256908] [ 26725] 0 26725 220435 169 47104 77 -999 containerd-shim
[245268.261220] [ 26741] 0 26741 50 0 4096 5 0 s6-svscan
[245268.265608] [ 26786] 0 26786 50 0 8192 3 0 s6-supervise
[245268.269857] [ 26941] 0 26941 2963 2 10240 178 -1000 udevd
[245268.273974] [ 27105] 0 27105 50 0 8192 3 0 s6-supervise
[245268.278262] [ 27109] 0 27109 149790 89828 690176 6176 0 python3
[245268.282645] [ 6377] 0 6377 20936 1003 65536 4132 0 ozwadmin
[245268.287071] [ 21128] 0 21128 340 52 10240 6 0 rlwrap
[245268.291392] [ 21129] 0 21129 323 0 8192 2 0 sh
[245268.295880] [ 14863] 0 14863 436 41 10240 0 0 auth_srv.sh
[245268.300319] [ 14874] 0 14874 436 41 8192 0 0 auth_srv.sh
[245268.304702] [ 14886] 0 14886 884 82 12288 0 0 curl
[245268.308930] [ 14901] 0 14901 436 39 8192 0 0 auth_srv.sh
[245268.313353] [ 14902] 0 14902 884 82 12288 0 0 curl
[245268.317766] [ 14911] 0 14911 436 39 8192 0 0 auth_srv.sh
[245268.322156] [ 14921] 0 14921 884 82 12288 0 0 curl
[245268.326463] [ 14940] 0 14940 884 82 10240 0 0 curl
[245268.330766] [ 14964] 0 14964 436 39 8192 0 0 auth_srv.sh
[245268.335129] [ 14969] 0 14969 436 41 8192 0 0 auth_srv.sh
[245268.339205] [ 14981] 0 14981 884 82 12288 0 0 curl
[245268.343311] [ 14986] 0 14986 436 39 10240 0 0 auth_srv.sh
[245268.347340] [ 14999] 0 14999 884 82 12288 0 0 curl
[245268.351332] [ 15003] 0 15003 436 41 10240 0 0 auth_srv.sh
[245268.355302] [ 15017] 0 15017 884 82 10240 0 0 curl
[245268.359204] [ 15020] 0 15020 436 41 8192 0 0 auth_srv.sh
[245268.363267] [ 15032] 0 15032 884 82 10240 0 0 curl
[245268.367237] [ 15036] 0 15036 436 39 10240 0 0 auth_srv.sh
[245268.371143] [ 15054] 0 15054 884 82 12288 0 0 curl
[245268.374987] [ 15057] 0 15057 436 39 8192 0 0 auth_srv.sh
[245268.378860] [ 15074] 0 15074 436 40 10240 0 0 auth_srv.sh
[245268.382699] [ 15077] 0 15077 884 82 12288 0 0 curl
[245268.386498] [ 15079] 0 15079 1895 98 16384 0 0 git
[245268.390154] [ 15092] 0 15092 436 39 8192 0 0 auth_srv.sh
[245268.394100] [ 15099] 0 15099 884 82 12288 0 0 curl
[245268.398061] [ 15102] 0 15102 436 41 12288 0 0 auth_srv.sh
[245268.402115] [ 15114] 0 15114 884 82 12288 0 0 curl
[245268.405986] [ 15122] 0 15122 436 41 10240 0 0 auth_srv.sh
[245268.409834] [ 15134] 0 15134 436 39 10240 0 0 auth_srv.sh
[245268.413749] [ 15140] 0 15140 884 82 12288 0 0 curl
[245268.417507] [ 15150] 0 15150 884 82 10240 0 0 curl
[245268.421161] [ 15157] 0 15157 436 39 10240 0 0 auth_srv.sh
[245268.424681] [ 15167] 0 15167 436 39 8192 0 0 auth_srv.sh
[245268.428238] [ 15172] 0 15172 884 82 14336 0 0 curl
[245268.431817] [ 15181] 0 15181 436 39 10240 0 0 auth_srv.sh
[245268.435364] [ 15187] 0 15187 436 39 12288 0 0 auth_srv.sh
[245268.438718] [ 15193] 0 15193 884 82 10240 0 0 curl
[245268.442059] [ 15209] 0 15209 436 39 8192 0 0 auth_srv.sh
[245268.445443] [ 15214] 0 15214 884 82 12288 0 0 curl
[245268.448756] [ 15220] 0 15220 884 82 10240 0 0 curl
[245268.452143] [ 15223] 0 15223 436 39 10240 0 0 auth_srv.sh
[245268.455451] [ 15236] 0 15236 436 39 10240 0 0 auth_srv.sh
[245268.458658] [ 15237] 0 15237 884 82 10240 0 0 curl
[245268.462003] [ 15246] 0 15246 436 39 10240 0 0 auth_srv.sh
[245268.465231] [ 15257] 0 15257 884 82 12288 0 0 curl
[245268.468406] [ 15262] 0 15262 1663 29 10240 0 0 git-remote-http
[245268.471636] [ 15316] 0 15316 884 82 14336 0 0 curl
[245268.474771] [ 15317] 0 15317 854 70 10240 0 0 curl
[245268.478016] [ 15326] 0 15326 884 82 10240 0 0 curl
[245268.481244] [ 15357] 0 15357 884 82 10240 0 0 curl
[245268.484454] [ 15388] 0 15388 436 39 10240 0 0 auth_srv.sh
[245268.487620] [ 15393] 0 15393 884 82 12288 0 0 curl
[245268.490581] [ 15403] 0 15403 436 39 10240 0 0 auth_srv.sh
[245268.493744] [ 15415] 0 15415 436 39 10240 0 0 auth_srv.sh
[245268.496816] [ 15417] 0 15417 1581 32 12288 0 0 systemd-coredum
[245268.499870] [ 15420] 0 15420 436 39 10240 0 0 auth_srv.sh
[245268.503054] [ 15428] 0 15428 436 39 10240 0 0 auth_srv.sh
[245268.506015] [ 15430] 0 15430 436 39 10240 0 0 auth_srv.sh
[245268.508955] [ 15441] 0 15441 703 85 10240 218 0 bash
[245268.512004] [ 15448] 0 15448 847 50 10240 0 0 curl
[245268.515031] [ 15461] 0 15461 823 14 8192 42 0 socat
[245268.518054] [ 15462] 0 15462 433 36 8192 0 0 auth_srv.sh
[245268.521035] [ 15469] 0 15469 424 26 10240 0 0 auth_srv.sh
[245268.523921] [ 15475] 0 15475 422 24 8192 0 0 auth_srv.sh
[245268.526890] [ 15496] 0 15496 361 43 8192 0 0 jq
[245268.529823] [ 15497] 0 15497 361 43 8192 0 0 jq
[245268.532799] [ 15500] 0 15500 339 21 8192 0 0 jq
[245268.535727] [ 15502] 0 15502 331 11 8192 0 0 jq
[245268.538484] [ 15504] 0 15504 339 21 8192 0 0 jq
[245268.541247] [ 15510] 0 15510 8304 164 38912 246 0 smbd
[245268.544116] [ 15512] 0 15512 716 12 8192 0 0 sshd
[245268.547010] [ 15513] 0 15513 8304 189 38912 221 0 smbd
[245268.549883] [ 15514] 0 15514 8304 222 38912 188 0 smbd
[245268.552766] [ 15516] 0 15516 436 39 8192 0 0 auth_srv.sh
[245268.555603] [ 15517] 0 15517 8443 84 38912 326 0 smbd
[245268.558422] [ 15518] 0 15518 8443 74 38912 336 0 smbd
[245268.561273] [ 15520] 0 15520 8443 74 38912 336 0 smbd
[245268.564106] [ 15521] 0 15521 684 9 8192 0 0 sshd
[245268.566916] [ 15522] 0 15522 8443 66 38912 344 0 smbd
[245268.569709] [ 15525] 0 15525 8443 58 36864 352 0 smbd
[245268.572462] [ 15526] 0 15526 8443 50 36864 360 0 smbd
[245268.575197] Out of memory: Kill process 27109 (python3) score 325 or sacrifice child
[245268.578259] Killed process 27109 (python3) total-vm:599160kB, anon-rss:359312kB, file-rss:0kB, shmem-rss:0kB
[245268.772799] oom_reaper: reaped process 27109 (python3), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
[245271.395084] audit: type=1701 audit(1607765219.859:404): auid=4294967295 uid=0 gid=0 ses=4294967295 subj==unconfined pid=6377 comm="ozwadmin" exe="/usr/local/bin/ozwadmin" sig=11 res=1
[245273.093825] systemd-coredump[15417]: Process 12318 (systemd-journal) of user 0 dumped core.
[245273.386615] systemd[1]: systemd-journald.service: State 'stop-watchdog' timed out. Terminating.
[245273.586517] systemd[1]: systemd-journald.service: Main process exited, code=dumped, status=6/ABRT
[245273.593200] systemd[1]: systemd-journald.service: Failed with result 'watchdog'.
[245273.608281] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 3.
[245273.629938] systemd[1]: Stopping Flush Journal to Persistent Storage...
[245273.645704] systemd[1]: Started Process Core Dump (PID 15549/UID 0).
[245273.692265] systemd[1]: systemd-journal-flush.service: Control process exited, code=exited, status=1/FAILURE
[245273.697507] systemd[1]: systemd-journal-flush.service: Failed with result 'exit-code'.
[245273.705755] systemd[1]: Stopped Flush Journal to Persistent Storage.
[245273.711825] systemd[1]: Stopped Journal Service.
[245273.724575] systemd[1]: Starting Journal Service...
[245273.807926] audit: type=1305 audit(1607765222.289:405): audit_enabled=1 old=1 auid=4294967295 ses=4294967295 subj==unconfined res=1
[245274.024270] systemd[1]: Starting Hostname Service...
[245275.889939] systemd[1]: Started Hostname Service.
[245276.196584] systemd[1]: [email protected] : Succeeded.
[245277.121742] systemd[1]: Started Journal Service.
[245277.170244] systemd-journald[15607]: Received client request to flush runtime journal.
[245304.800899] audit: type=1325 audit(1607765253.288:406): table=nat family=2 entries=35
[245304.806101] audit: type=1300 audit(1607765253.288:406): arch=40000028 syscall=294 per=800000 success=yes exit=0 a0=4 a1=0 a2=40 a3=f3e898 items=0 ppid=345 pid=16332 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="iptables" exe="/usr/sbin/xtables-legacy-multi" subj==unconfined key=(null)
[245304.821913] audit: type=1327 audit(1607765253.288:406): proctitle=2F7573722F7362696E2F69707461626C6573002D2D77616974002D74006E6174002D4400444F434B4552002D7000746370002D6400302F30002D2D64706F72740035393030002D6A00444E4154002D2D746F2D64657374696E6174696F6E003137322E33302E33332E343A353930300000002D690068617373696F
[245304.844877] audit: type=1325 audit(1607765253.338:407): table=filter family=2 entries=40
[245304.851216] audit: type=1300 audit(1607765253.338:407): arch=40000028 syscall=294 per=800000 success=yes exit=0 a0=4 a1=0 a2=40 a3=6f6528 items=0 ppid=345 pid=16334 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="iptables" exe="/usr/sbin/xtables-legacy-multi" subj==unconfined key=(null)
[245304.870495] audit: type=1327 audit(1607765253.338:407): proctitle=2F7573722F7362696E2F69707461626C6573002D2D77616974002D740066696C746572002D4400444F434B45520000002D690068617373696F002D6F0068617373696F002D7000746370002D64003137322E33302E33332E34002D2D64706F72740035393030002D6A00414343455054
[245304.884704] audit: type=1325 audit(1607765253.368:408): table=nat family=2 entries=34
[245304.892476] audit: type=1300 audit(1607765253.368:408): arch=40000028 syscall=294 per=800000 success=yes exit=0 a0=4 a1=0 a2=40 a3=11a3640 items=0 ppid=345 pid=16336 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="iptables" exe="/usr/sbin/xtables-legacy-multi" subj==unconfined key=(null)
[245304.915373] audit: type=1327 audit(1607765253.368:408): proctitle=2F7573722F7362696E2F69707461626C6573002D2D77616974002D74006E6174002D4400504F5354524F5554494E47002D7000746370002D73003137322E33302E33332E34002D64003137322E33302E33332E34002D2D64706F72740035393030002D6A004D415351554552414445
[245304.930811] audit: type=1325 audit(1607765253.408:409): table=nat family=2 entries=33
[245304.999331] hassio: port 10(vethc6b42ef) entered disabled state
[245305.006782] vetha444161: renamed from eth0
[245305.204941] hassio: port 10(vethc6b42ef) entered disabled state
[245305.216290] device vethc6b42ef left promiscuous mode
[245305.223236] hassio: port 10(vethc6b42ef) entered disabled state
[245310.624881] hassio: port 10(vethb2b0a4b) entered blocking state
[245310.632689] hassio: port 10(vethb2b0a4b) entered disabled state
[245310.647606] device vethb2b0a4b entered promiscuous mode
[245310.655061] kauditd_printk_skb: 11 callbacks suppressed
[245310.655083] audit: type=1700 audit(1607765259.118:413): dev=vethb2b0a4b prom=256 old_prom=0 auid=4294967295 uid=0 gid=0 ses=4294967295
[245310.663980] IPv6: ADDRCONF(NETDEV_UP): vethb2b0a4b: link is not ready
[245310.669895] audit: type=1300 audit(1607765259.118:413): arch=40000028 syscall=290 per=800000 success=yes exit=40 a0=c a1=36896e0 a2=28 a3=0 items=0 ppid=1 pid=345 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="dockerd" exe="/usr/bin/dockerd" subj==unconfined key=(null)
[245310.669910] audit: type=1327 audit(1607765259.118:413): proctitle=2F7573722F62696E2F646F636B657264002D480066643A2F2F002D2D73746F726167652D6472697665723D6F7665726C617932002D2D6C6F672D6472697665723D6A6F75726E616C64002D2D646174612D726F6F74002F6D6E742F646174612F646F636B6572
[245310.748713] audit: type=1325 audit(1607765259.238:414): table=nat family=2 entries=31
[245310.757079] audit: type=1300 audit(1607765259.238:414): arch=40000028 syscall=294 per=800000 success=yes exit=0 a0=4 a1=0 a2=40 a3=1eecfc0 items=0 ppid=345 pid=16359 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="iptables" exe="/usr/sbin/xtables-legacy-multi" subj==unconfined key=(null)
[245310.780205] audit: type=1327 audit(1607765259.238:414): proctitle=2F7573722F7362696E2F69707461626C6573002D2D77616974002D74006E6174002D4100444F434B4552002D7000746370002D6400302F30002D2D64706F72740035393030002D6A00444E4154002D2D746F2D64657374696E6174696F6E003137322E33302E33332E343A353930300000002D690068617373696F
[245310.807798] audit: type=1325 audit(1607765259.298:415): table=filter family=2 entries=38
[245310.816507] audit: type=1300 audit(1607765259.298:415): arch=40000028 syscall=294 per=800000 success=yes exit=0 a0=4 a1=0 a2=40 a3=ec80d8 items=0 ppid=345 pid=16361 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="iptables" exe="/usr/sbin/xtables-legacy-multi" subj==unconfined key=(null)
[245310.840251] audit: type=1327 audit(1607765259.298:415): proctitle=2F7573722F7362696E2F69707461626C6573002D2D77616974002D740066696C746572002D4100444F434B45520000002D690068617373696F002D6F0068617373696F002D7000746370002D64003137322E33302E33332E34002D2D64706F72740035393030002D6A00414343455054
[245310.861830] audit: type=1325 audit(1607765259.348:416): table=nat family=2 entries=32
[245312.305548] eth0: renamed from veth8ad3aa3
[245312.383067] IPv6: ADDRCONF(NETDEV_CHANGE): vethb2b0a4b: link becomes ready
[245312.390568] hassio: port 10(vethb2b0a4b) entered blocking state
[245312.397960] hassio: port 10(vethb2b0a4b) entered forwarding state
[245325.786695] kauditd_printk_skb: 41 callbacks suppressed
[245325.786704] audit: type=1701 audit(1607765274.278:430): auid=4294967295 uid=0 gid=0 ses=4294967295 subj==unconfined pid=16856 comm="ozwadmin" exe="/usr/local/bin/ozwadmin" sig=11 res=1
callacomp
December 17, 2020, 1:01am
4
SOLVED: If others get this error and specifically find these in your logs:oom_kill_processout_of_memoryhttps://www.linuxatemyram.com/ 44](https://www.linuxatemyram.com/ 44) for an explanation and some tips to look at your memory usage. Also try glances, mind this has a high memory usage.
