My InfluxDB does not start anymore, it crashes after several minutes. Auto-start doesn’t work either. I only realized that my InfluxDB is not working after Grafana did no longer show any values. I can’t tell when this started. But I remember having seen all values missing in Grafana a few days back for several hours.
The log below is of today. After that, I tried to restore the add-on with a partial backup from 3 days ago. Didn’t help, same result.
s6-rc: info: service s6rc-oneshot-runner: starting
s6-rc: info: service s6rc-oneshot-runner successfully started
s6-rc: info: service fix-attrs: starting
s6-rc: info: service fix-attrs successfully started
s6-rc: info: service legacy-cont-init: starting
cont-init: info: running /etc/cont-init.d/00-banner.sh
-----------------------------------------------------------
Add-on: InfluxDB
Scalable datastore for metrics, events, and real-time analytics
-----------------------------------------------------------
Add-on version: 4.5.0
You are running the latest version of this add-on.
System: Home Assistant OS 8.5 (armv7 / raspberrypi4)
Home Assistant Core: 2022.8.7
Home Assistant Supervisor: 2022.08.3
-----------------------------------------------------------
Please, share the above information when looking for help
or support in, e.g., GitHub, forums or the Discord chat.
-----------------------------------------------------------
cont-init: info: /etc/cont-init.d/00-banner.sh exited 0
cont-init: info: running /etc/cont-init.d/01-log-level.sh
Log level is set to DEBUG
cont-init: info: /etc/cont-init.d/01-log-level.sh exited 0
cont-init: info: running /etc/cont-init.d/02-set-timezone.sh
[23:10:02] INFO: Configuring timezone
cont-init: info: /etc/cont-init.d/02-set-timezone.sh exited 0
cont-init: info: running /etc/cont-init.d/create-users.sh
cont-init: info: /etc/cont-init.d/create-users.sh exited 0
cont-init: info: running /etc/cont-init.d/influxdb.sh
cont-init: info: /etc/cont-init.d/influxdb.sh exited 0
cont-init: info: running /etc/cont-init.d/kapacitor.sh
cont-init: info: /etc/cont-init.d/kapacitor.sh exited 0
cont-init: info: running /etc/cont-init.d/nginx.sh
[23:10:04] DEBUG: Requested API resource: http://supervisor/dns/info
[23:10:04] DEBUG: Request method: GET
[23:10:04] DEBUG: Request data: {}
[23:10:04] DEBUG: API HTTP Response code: 200
[23:10:04] DEBUG: API Response: {"result": "ok", "data": {"version": "2022.04.1", "version_latest": "2022.04.1", "update_available": false, "host": "172.30.32.3", "servers": [], "locals": ["dns://192.168.178.1"], "mdns": true, "llmnr": true, "fallback": true}}
cont-init: info: /etc/cont-init.d/nginx.sh exited 0
s6-rc: info: service legacy-cont-init successfully started
s6-rc: info: service legacy-services: starting
services-up: info: copying legacy longrun chronograf (no readiness notification)
services-up: info: copying legacy longrun influxdb (no readiness notification)
services-up: info: copying legacy longrun kapacitor (no readiness notification)
services-up: info: copying legacy longrun nginx (no readiness notification)
s6-rc: info: service legacy-services successfully started
[23:10:05] INFO: Chronograf is waiting until InfluxDB is available...
[23:10:05] INFO: Kapacitor is waiting until InfluxDB is available...
[23:10:05] INFO: Starting the InfluxDB...
'##:::'##::::'###::::'########:::::'###:::::'######::'####:'########::'#######::'########::
##::'##::::'## ##::: ##.... ##:::'## ##:::'##... ##:. ##::... ##..::'##.... ##: ##.... ##:
##:'##::::'##:. ##:: ##:::: ##::'##:. ##:: ##:::..::: ##::::: ##:::: ##:::: ##: ##:::: ##:
#####::::'##:::. ##: ########::'##:::. ##: ##:::::::: ##::::: ##:::: ##:::: ##: ########::
##. ##::: #########: ##.....::: #########: ##:::::::: ##::::: ##:::: ##:::: ##: ##.. ##:::
##:. ##:: ##.... ##: ##:::::::: ##.... ##: ##::: ##:: ##::::: ##:::: ##:::: ##: ##::. ##::
##::. ##: ##:::: ##: ##:::::::: ##:::: ##:. ######::'####:::: ##::::. #######:: ##:::. ##:
..::::..::..:::::..::..:::::::::..:::::..:::......:::....:::::..::::::.......:::..:::::..::
2022/08/28 23:10:35 Using configuration at: /etc/kapacitor/kapacitor.conf
[23:10:41] INFO: Starting Chronograf...
time="2022-08-28T23:11:28+02:00" level=info msg="Serving chronograf at http://127.0.0.1:8889" component=server
time="2022-08-28T23:11:28+02:00" level=info msg="Reporting usage stats" component=usage freq=24h reporting_addr="https://usage.influxdata.com" stats="os,arch,version,cluster_id,uptime"
[23:11:28] INFO: Starting NGINX...
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*tsmBatchKeyIterator).mergeString(0x40e61e0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.gen.go:1730 +0x24c
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*tsmBatchKeyIterator).merge(0x40e61e0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1856 +0x1e4
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*tsmBatchKeyIterator).Next(0x40e61e0, 0x294f7f9)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1833 +0x10c
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).write(0x41008a0, 0x860c820, 0x49, 0x1ec9988, 0x40e61e0, 0x7dea701, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1141 +0x150
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).writeNewFiles(0x41008a0, 0xc, 0x2, 0x8e72d80, 0x5, 0x8, 0x1ec9988, 0x40e61e0, 0x1, 0x1ec9988, ...)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1045 +0x11c
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).compact(0x41008a0, 0x8e72d00, 0x8e72d80, 0x5, 0x8, 0x0, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:953 +0x4a0
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).CompactFull(0x41008a0, 0x8e72d80, 0x5, 0x8, 0x0, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:971 +0x110
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*compactionStrategy).compactGroup(0x8e72dc0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:2289 +0xfdc
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*compactionStrategy).Apply(0x8e72dc0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:2266 +0x2c
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactFull.func1(0xd6e4ab0, 0x4b9a6c0, 0x8e72dc0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:2235 +0xc4
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactFull
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:2231 +0xd0
goroutine 3399 [runnable]:
syscall.Syscall(0x4, 0x61, 0x1fa5a000, 0x100000, 0x100000, 0x0, 0x0)
/usr/local/go/src/syscall/asm_linux_arm.s:14 +0x8
syscall.write(0x61, 0x1fa5a000, 0x100000, 0x100000, 0x0, 0xc4, 0x0)
/usr/local/go/src/syscall/zsyscall_linux_arm.go:1005 +0x40
syscall.Write(...)
/usr/local/go/src/syscall/syscall_unix.go:202
internal/poll.(*FD).Write(0xb85a780, 0x1fa5a000, 0x100000, 0x100000, 0x0, 0x0, 0x0)
/usr/local/go/src/internal/poll/fd_unix.go:268 +0x144
os.(*File).write(...)
/usr/local/go/src/os/file_unix.go:276
os.(*File).Write(0x4666e68, 0x1fa5a000, 0x100000, 0x100000, 0x23b5a3e0, 0x10, 0x156e8)
/usr/local/go/src/os/file.go:153 +0x5c
github.com/influxdata/influxdb/pkg/limiter.(*Writer).Write(0x4235dc0, 0x1fa5a000, 0x100000, 0x100000, 0xad20000, 0x240f8828, 0x7)
/go/src/github.com/influxdata/influxdb/pkg/limiter/writer.go:64 +0xc8
bufio.(*Writer).Flush(0x4235e20, 0x240f7500, 0xbc1)
/usr/local/go/src/bufio/bufio.go:593 +0x60
bufio.(*Writer).Write(0x4235e20, 0x240f7500, 0x132f, 0x1337, 0x4, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:629 +0xec
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*tsmWriter).WriteBlock(0x5adf410, 0x58d70e0, 0x59, 0x60, 0x85073a98, 0x170e66a1, 0xeaf1bf0, 0x170f9e58, 0x240f7500, 0x132f, ...)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/writer.go:679 +0x134
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).write(0x40d3080, 0x58208c0, 0x49, 0x1ec9938, 0xb85a740, 0x7d9b201, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1162 +0x218
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).writeNewFiles(0x40d3080, 0x38, 0x1, 0x0, 0x0, 0x0, 0x1ec9938, 0xb85a740, 0x1, 0x0, ...)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1045 +0x11c
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).WriteSnapshot.func1(0x724a240, 0x40d3080, 0xaeca9c8, 0xb85a700, 0x5f62c00)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:860 +0x94
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).WriteSnapshot
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:858 +0x16c
goroutine 3403 [runnable]:
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*encoder).Write(0x43285a0, 0x17f006b0, 0x170e3df2)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/timestamp.go:81 +0xb4
github.com/influxdata/influxdb/tsdb/engine/tsm1.encodeStringBlockUsing(0x0, 0x0, 0x0, 0x74ec000, 0x3e8, 0x2400, 0x1ec0f50, 0x43285a0, 0x24242000, 0x50c, ...)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/encoding.go:865 +0x74
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*cacheKeyIterator).encode.func1(0xaeca9d8, 0x1, 0x3f5, 0xb85a740)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:2011 +0x674
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*cacheKeyIterator).encode
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1965 +0x80
goroutine 3404 [running]:
runtime.throw(0xfebdde, 0xd)
/usr/local/go/src/runtime/panic.go:774 +0x5c fp=0x127b7c58 sp=0x127b7c44 pc=0x41644
runtime.(*mcache).refill(0xb6f43a34, 0x75)
/usr/local/go/src/runtime/mcache.go:140 +0xfc fp=0x127b7c6c sp=0x127b7c58 pc=0x262ec
runtime.(*mcache).nextFree(0xb6f43a34, 0x75, 0x0, 0x0, 0x180000)
/usr/local/go/src/runtime/malloc.go:854 +0x7c fp=0x127b7c8c sp=0x127b7c6c pc=0x1b0f4
runtime.mallocgc(0x4000, 0xe1f330, 0x4312401, 0x4332008)
/usr/local/go/src/runtime/malloc.go:1022 +0x7a0 fp=0x127b7cf4 sp=0x127b7c8c pc=0x1ba40
runtime.makeslice(0xe1f330, 0x39e3, 0x39e3, 0x0)
/usr/local/go/src/runtime/slice.go:49 +0x6c fp=0x127b7d08 sp=0x127b7cf4 pc=0x5928c
github.com/influxdata/influxdb/vendor/github.com/golang/snappy.Encode(0x0, 0x0, 0x0, 0x2417f500, 0x3183, 0x3500, 0x62a2f70, 0x1, 0x0)
/go/src/github.com/influxdata/influxdb/vendor/github.com/golang/snappy/encode.go:22 +0x2b8 fp=0x127b7d40 sp=0x127b7d08 pc=0x558d70
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*StringEncoder).Bytes(...)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/string.go:56
github.com/influxdata/influxdb/tsdb/engine/tsm1.encodeStringBlockUsing(0x0, 0x0, 0x0, 0x900e000, 0x34d, 0x400, 0x1ec0f50, 0x43285e0, 0x2417f500, 0x3183, ...)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/encoding.go:875 +0x134 fp=0x127b7da8 sp=0x127b7d40 pc=0xcc0c80
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*cacheKeyIterator).encode.func1(0xaeca9d8, 0x1, 0x3f5, 0xb85a740)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:2011 +0x674 fp=0x127b7fdc sp=0x127b7da8 pc=0xd14150
runtime.goexit()
/usr/local/go/src/runtime/asm_arm.s:868 +0x4 fp=0x127b7fdc sp=0x127b7fdc pc=0x73610
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*cacheKeyIterator).encode
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1965 +0x80
[23:14:40] WARNING: InfluxDB crashed, halting add-on
s6-rc: info: service legacy-services: stopping
[23:14:40] INFO: InfluxDB stopped, restarting...
[23:14:40] INFO: Kapacitor stopped, restarting...
[23:14:40] INFO: NGINX stopped, restarting...
[23:14:40] INFO: Chronograf stopped, restarting...
s6-svwait: fatal: timed out
s6-rc: info: service legacy-services successfully stopped
s6-rc: info: service legacy-cont-init: stopping
s6-rc: info: service legacy-cont-init successfully stopped
s6-rc: info: service fix-attrs: stopping
s6-rc: info: service fix-attrs successfully stopped
s6-rc: info: service s6rc-oneshot-runner: stopping
s6-rc: info: service s6rc-oneshot-runner successfully stopped
.
.
.
.
Update: the log below is with trace level. Just the part before it crashes.
[23:45:34] INFO: Starting NGINX...
[23:45:34] TRACE: bashio::config.true: leave_front_door_open
[23:45:34] TRACE: bashio::config: leave_front_door_open
[23:45:34] TRACE: bashio::addon.config
[23:45:34] TRACE: bashio::cache.exists: addons.self.options.config
[23:45:34] TRACE: bashio::fs.file_exists: /tmp/.bashio/addons.self.options.config.cache
[23:45:34] TRACE: bashio::cache.get: addons.self.options.config
[23:45:34] TRACE: bashio::cache.exists: addons.self.options.config
[23:45:34] TRACE: bashio::fs.file_exists: /tmp/.bashio/addons.self.options.config.cache
[23:45:34] TRACE: bashio::jq: {"auth":true,"certfile":"fullchain.pem","envvars":[],"keyfile":"privkey.pem","reporting":true,"ssl":true,"log_level":"trace"} if (.leave_front_door_open == null) then
null
elif (.leave_front_door_open | type == "string") then
.leave_front_door_open // empty
elif (.leave_front_door_open | type == "boolean") then
.leave_front_door_open // false
elif (.leave_front_door_open | type == "array") then
if (.leave_front_door_open == []) then
empty
else
.leave_front_door_open[]
end
elif (.leave_front_door_open | type == "object") then
if (.leave_front_door_open == {}) then
empty
else
.leave_front_door_open
end
else
.leave_front_door_open
end
[23:45:35] TRACE: bashio::var.true: null
bufio.(*Reader).fill(0x60abef0)
/usr/local/go/src/bufio/bufio.go:100 +0x108
bufio.(*Reader).Peek(0x60abef0, 0x1, 0x2, 0x0, 0x0, 0xb178b00, 0x0)
/usr/local/go/src/bufio/bufio.go:138 +0x38
net/http.(*persistConn).readLoop(0x4ce9040)
/usr/local/go/src/net/http/transport.go:1911 +0x178
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1580 +0x8f0
goroutine 1002 [IO wait]:
internal/poll.runtime_pollWait(0xa6d3fc68, 0x72, 0xffffffff)
/usr/local/go/src/runtime/netpoll.go:184 +0x44
internal/poll.(*pollDesc).wait(0xdd4c884, 0x72, 0x1000, 0x1000, 0xffffffff)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x30
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xdd4c870, 0x9a5f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/internal/poll/fd_unix.go:169 +0x178
net.(*netFD).Read(0xdd4c870, 0x9a5f000, 0x1000, 0x1000, 0x1, 0x1, 0x0)
/usr/local/go/src/net/fd_unix.go:202 +0x38
net.(*conn).Read(0xdc161e0, 0x9a5f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:184 +0x58
net/http.(*persistConn).Read(0x4ce90e0, 0x9a5f000, 0x1000, 0x1000, 0x70df8, 0xf8a9ef4, 0x2)
/usr/local/go/src/net/http/transport.go:1758 +0x164
bufio.(*Reader).fill(0x5ef5050)
/usr/local/go/src/bufio/bufio.go:100 +0x108
bufio.(*Reader).Peek(0x5ef5050, 0x1, 0x2, 0x0, 0x0, 0x7a96900, 0x0)
/usr/local/go/src/bufio/bufio.go:138 +0x38
net/http.(*persistConn).readLoop(0x4ce90e0)
/usr/local/go/src/net/http/transport.go:1911 +0x178
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1580 +0x8f0
goroutine 2397 [runnable]:
github.com/influxdata/influxdb/vendor/github.com/jwilder/encoding/simple8b.(*Encoder).Write(0x4f5e030, 0xb7acf2, 0x0, 0x0, 0xb7acf2)
/go/src/github.com/influxdata/influxdb/vendor/github.com/jwilder/encoding/simple8b/encoding.go:76 +0x130
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*encoder).encodePacked(0x4f4f6c0, 0x3e8, 0x0, 0x4f60000, 0x3e8, 0x3e8, 0x4f60000, 0x3e8, 0x3e8, 0x10b1ec20, ...)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/timestamp.go:145 +0xf8
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*encoder).Bytes(0x4f4f6c0, 0x0, 0x406e0000, 0xf00, 0x11c7b000, 0xde9)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/timestamp.go:138 +0xec
github.com/influxdata/influxdb/tsdb/engine/tsm1.encodeFloatBlockUsing(0x0, 0x0, 0x0, 0x13197040, 0x3e8, 0x25f8, 0x1ec0f50, 0x4f4f6c0, 0xddff100, 0x24ff9300, ...)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/encoding.go:382 +0xf0
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*cacheKeyIterator).encode.func1(0x762a9b8, 0x1, 0x3f5, 0xd308880)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:2003 +0x310
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*cacheKeyIterator).encode
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1965 +0x80
goroutine 2148 [running]:
runtime.throw(0xfebdde, 0xd)
/usr/local/go/src/runtime/panic.go:774 +0x5c fp=0x1772535c sp=0x17725348 pc=0x41644
runtime.(*mcache).refill(0xb6fb76d0, 0x6a)
/usr/local/go/src/runtime/mcache.go:140 +0xfc fp=0x17725370 sp=0x1772535c pc=0x262ec
runtime.(*mcache).nextFree(0xb6fb76d0, 0x286a, 0x0, 0x20ef3600, 0x6fc90)
/usr/local/go/src/runtime/malloc.go:854 +0x7c fp=0x17725390 sp=0x17725370 pc=0x1b0f4
runtime.mallocgc(0x2800, 0xe1f0f0, 0x701, 0x24ebb800)
/usr/local/go/src/runtime/malloc.go:1022 +0x7a0 fp=0x177253f8 sp=0x17725390 pc=0x1ba40
runtime.growslice(0xe1f0f0, 0x21075740, 0xeb, 0x118, 0x4c3, 0x24ebb800, 0xeb, 0x500)
/usr/local/go/src/runtime/slice.go:181 +0x190 fp=0x17725428 sp=0x177253f8 pc=0x595bc
github.com/influxdata/influxdb/tsdb/cursors.(*StringArray).Merge(0x4f7e540, 0x1772555c)
/go/src/github.com/influxdata/influxdb/tsdb/cursors/arrayvalues.gen.go:751 +0x994 fp=0x177254c0 sp=0x17725428 pc=0x537dcc
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*tsmBatchKeyIterator).combineString(0x4dd6000, 0x11696001, 0x2c, 0x116960b0, 0x2)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.gen.go:1798 +0x778 fp=0x17725574 sp=0x177254c0 pc=0xca6394
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*tsmBatchKeyIterator).mergeString(0x4dd6000)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.gen.go:1730 +0x24c fp=0x1772558c sp=0x17725574 pc=0xca5ad0
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*tsmBatchKeyIterator).merge(0x4dd6000)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1856 +0x1e4 fp=0x177255d4 sp=0x1772558c pc=0xcb0d20
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*tsmBatchKeyIterator).Next(0x4dd6000, 0x145eccf)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1708 +0x10ec fp=0x17725710 sp=0x177255d4 pc=0xcb099c
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).write(0x4cd5200, 0x927a550, 0x49, 0x1ec9988, 0x4dd6000, 0x74bd501, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1141 +0x150 fp=0x177257cc sp=0x17725710 pc=0xcae7b8
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).writeNewFiles(0x4cd5200, 0xa, 0x2, 0xdb4f400, 0x8, 0x8, 0x1ec9988, 0x4dd6000, 0x1, 0x1ec9988, ...)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:1045 +0x11c fp=0x17725824 sp=0x177257cc pc=0xcae2ac
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).compact(0x4cd5200, 0xdb4f400, 0xdb4f400, 0x8, 0x8, 0x0, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:953 +0x4a0 fp=0x177258a0 sp=0x17725824 pc=0xcada54
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).CompactFull(0x4cd5200, 0xdb4f400, 0x8, 0x8, 0x0, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:971 +0x110 fp=0x1772591c sp=0x177258a0 pc=0xcadbf0
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*compactionStrategy).compactGroup(0xdb4f5c0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:2289 +0xfdc fp=0x17725f20 sp=0x1772591c pc=0xccf0ec
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*compactionStrategy).Apply(0xdb4f5c0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:2266 +0x2c fp=0x17725f54 sp=0x17725f20 pc=0xcce0d0
github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactHiPriorityLevel.func1(0xf804170, 0x5a96b40, 0x1, 0xdb4f5c0)
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:2183 +0xd8 fp=0x17725fdc sp=0x17725f54 pc=0xd18dd4
runtime.goexit()
/usr/local/go/src/runtime/asm_arm.s:868 +0x4 fp=0x17725fdc sp=0x17725fdc pc=0x73610
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Engine).compactHiPriorityLevel
/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:2178 +0xf4
[23:47:04] WARNING: InfluxDB crashed, halting add-on
s6-rc: info: service legacy-services: stopping
[23:47:04] INFO: InfluxDB stopped, restarting...
[23:47:04] INFO: InfluxDB stopped, restarting...
[23:47:04] INFO: Chronograf stopped, restarting...
s6-svwait: fatal: supervisor died
s6-rc: info: service legacy-services successfully stopped
s6-rc: info: service legacy-cont-init: stopping
[23:47:04] INFO: NGINX stopped, restarting...
s6-rc: info: service legacy-cont-init successfully stopped
s6-rc: info: service fix-attrs: stopping
s6-rc: info: service fix-attrs successfully stopped
s6-rc: info: service s6rc-oneshot-runner: stopping
s6-rc: info: service s6rc-oneshot-runner successfully stopped