Influxdb - doesn't start any more

Hi, I’m running hassio 98.5 with influxdb as an addon. influxdb stopped working 2 or 3 days ago. I’m not able to restart the database any more. The portainer addon shows the following error message: “Container addon_a0d7b954_influxdb exited with status code 129”.

Ideas ?

Thank you very much !

Alex

Hi Alex, did you solve your problem, because I have exactly the same error in portainer:
Container addon_a0d7b954_influxdb exited with status code 129

I’m on 0.103.6 currently, but I’m having the issue for a while already.

Hassio Influxdb log when starting:

[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] 00-banner.sh: executing... 

-----------------------------------------------------------
 Hass.io Add-on: InfluxDB
 Scalable datastore for metrics, events, and real-time analytics
-----------------------------------------------------------
 Add-on version: 3.5.1
 You are running the latest version of this add-on.
 System: Raspbian GNU/Linux 10 (buster)  (armv7 / raspberrypi4)
 Home Assistant version: 0.103.6
 Supervisor version: 195
-----------------------------------------------------------
 Please, share the above information when looking for help
 or support in, e.g., GitHub, forums or the Discord chat.
-----------------------------------------------------------
[cont-init.d] 00-banner.sh: exited 0.
[cont-init.d] 01-log-level.sh: executing... 
[cont-init.d] 01-log-level.sh: exited 0.
[cont-init.d] create-users.sh: executing... 
[cont-init.d] create-users.sh: exited 0.
[cont-init.d] influxdb.sh: executing... 
[cont-init.d] influxdb.sh: exited 0.
[cont-init.d] kapacitor.sh: executing... 
[cont-init.d] kapacitor.sh: exited 0.
[cont-init.d] nginx.sh: executing... 
[cont-init.d] nginx.sh: exited 0.
[cont-init.d] done.
[services.d] starting services
[services.d] done.
[23:41:15] INFO: Kapacitor is waiting until InfluxDB is available...
[23:41:15] INFO: Chronograf is waiting until InfluxDB is available...
[23:41:15] INFO: Starting the InfluxDB...

after a while it says:

created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x7ac

goroutine 507 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0xc87a600, 0x1aa63a8, 0x1721ced0, 0x2caf088, 0x2caf090, 0x2820990)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0x162886c0, 0xc87a600, 0x1aa63a8, 0x1721ced0, 0x2caf088, 0x2caf090, 0x2820990)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x44
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x7ac

goroutine 508 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0xc87a600, 0x1aa63a8, 0x1721ced0, 0x2caf088, 0x2caf090, 0x2820990)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0x162886c0, 0xc87a600, 0x1aa63a8, 0x1721ced0, 0x2caf088, 0x2caf090, 0x2820990)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x44
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x7ac

goroutine 509 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0xc87a600, 0x1aa63a8, 0x1721ced0, 0x2caf088, 0x2caf090, 0x2820990)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0x162886c0, 0xc87a600, 0x1aa63a8, 0x1721ced0, 0x2caf088, 0x2caf090, 0x2820990)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x44
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x7ac

goroutine 532 [select]:
net/http.setRequestCancel.func3(0x0, 0x281ed00, 0x1730a480, 0x1628887c, 0x17d5e680)
	/usr/local/go/src/net/http/client.go:321 +0x78
created by net/http.setRequestCancel
	/usr/local/go/src/net/http/client.go:320 +0x21c

goroutine 546 [IO wait]:
internal/poll.runtime_pollWait(0xa6c5dd80, 0x72, 0xffffffff)
	/usr/local/go/src/runtime/netpoll.go:182 +0x48
internal/poll.(*pollDesc).wait(0xdb52014, 0x72, 0x1000, 0x1000, 0xffffffff)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x80
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xdb52000, 0xdb84000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:169 +0x184
net.(*netFD).Read(0xdb52000, 0xdb84000, 0x1000, 0x1000, 0x30f318, 0x1049a2a4, 0xffffffff)
	/usr/local/go/src/net/fd_unix.go:202 +0x38
net.(*conn).Read(0x129641f8, 0xdb84000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:177 +0x5c
net/http.(*connReader).Read(0x1049a2a0, 0xdb84000, 0x1000, 0x1000, 0x27507f8, 0x0, 0x0)
	/usr/local/go/src/net/http/server.go:787 +0x16c
bufio.(*Reader).fill(0x16b5e150)
	/usr/local/go/src/bufio/bufio.go:100 +0x114
bufio.(*Reader).Peek(0x16b5e150, 0x4, 0x0, 0x0, 0x0, 0x0, 0x0)
	/usr/local/go/src/bufio/bufio.go:138 +0x38
net/http.(*conn).readRequest(0x2e4f1a0, 0x1ab7a20, 0x1049a280, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/http/server.go:964 +0xb18
net/http.(*conn).serve(0x2e4f1a0, 0x1ab7a20, 0x1049a280)
	/usr/local/go/src/net/http/server.go:1819 +0x63c
created by net/http.(*Server).Serve
	/usr/local/go/src/net/http/server.go:2884 +0x298

goroutine 256 [IO wait]:
internal/poll.runtime_pollWait(0xa6c5de04, 0x72, 0xffffffff)
	/usr/local/go/src/runtime/netpoll.go:182 +0x48
internal/poll.(*pollDesc).wait(0x2914c94, 0x72, 0xe00, 0xe6f, 0xffffffff)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x80
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0x2914c80, 0x4675000, 0xe6f, 0xe6f, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:169 +0x184
net.(*netFD).Read(0x2914c80, 0x4675000, 0xe6f, 0xe6f, 0x56, 0x1b96c, 0xbe7c560)
	/usr/local/go/src/net/fd_unix.go:202 +0x38
net.(*conn).Read(0x134d4030, 0x4675000, 0xe6f, 0xe6f, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:177 +0x5c
crypto/tls.(*atLeastReader).Read(0xbe7c560, 0x4675000, 0xe6f, 0xe6f, 0x18148, 0x267d34, 0x1aa80b8)
	/usr/local/go/src/crypto/tls/conn.go:761 +0x78
bytes.(*Buffer).ReadFrom(0x9426360, 0x1aa4f08, 0xbe7c560, 0xb, 0x266700, 0xd42168, 0xe79538)
	/usr/local/go/src/bytes/buffer.go:207 +0xac
crypto/tls.(*Conn).readFromUntil(0x9426200, 0x1aa80b8, 0x134d4030, 0x5, 0x134d4030, 0x2494cf0f)
	/usr/local/go/src/crypto/tls/conn.go:783 +0xd8
crypto/tls.(*Conn).readRecordOrCCS(0x9426200, 0x18e6e00, 0x94262b0, 0x4d44a00b)
	/usr/local/go/src/crypto/tls/conn.go:590 +0x108
crypto/tls.(*Conn).readRecord(...)
	/usr/local/go/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0x9426200, 0x164bd000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/crypto/tls/conn.go:1236 +0x140
net/http.(*persistConn).Read(0x28ca140, 0x164bd000, 0x1000, 0x1000, 0x40d7f24, 0x2, 0x2)
	/usr/local/go/src/net/http/transport.go:1524 +0x1c0
bufio.(*Reader).fill(0x66cc7e0)
	/usr/local/go/src/bufio/bufio.go:100 +0x114
bufio.(*Reader).Peek(0x66cc7e0, 0x1, 0x2, 0x0, 0x0, 0x17b61d00, 0x0)
	/usr/local/go/src/bufio/bufio.go:138 +0x38
net/http.(*persistConn).readLoop(0x28ca140)
	/usr/local/go/src/net/http/transport.go:1677 +0x168
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1357 +0x924
[cont-finish.d] executing container finish scripts...
[cont-finish.d] 99-message.sh: executing... 
[cont-finish.d] 99-message.sh: exited 0.
[cont-finish.d] done.
[s6-finish] waiting for services.
[s6-finish] sending all processes the TERM signal.

Regards,
Bart

Hello Bart, I have no idea. I think it has something to do with the memory (sd card). after an influxdb update the error still occurs sometimes. in that case a restart helps.

Alex

Thanks for replying @ako.

I have Hassio running on a SSD and a microSD (only read during startup) in my Raspberry PI 4.
When I reboot the RP4, influxdb doesn’t crash right away, but I can’t access the webpage.
After some time I get a different error:

goroutine 531 [select]:
net/http.(*persistConn).writeLoop(0x28e4140)
	/usr/local/go/src/net/http/transport.go:1976 +0xb8
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1358 +0x940
ts=2020-01-16T12:18:55.951+01:00 lvl=error msg="encountered error" service=run err="open server: open service *influxdb.Service: failed to link subscription on startup: Post http://localhost:8086/query?db=&q=SHOW+SUBSCRIPTIONS: EOF"
run: open server: open service *influxdb.Service: failed to link subscription on startup: Post http://localhost:8086/query?db=&q=SHOW+SUBSCRIPTIONS: EOF
s6-svscanctl: fatal: unable to control /var/run/s6/services: supervisor not listening
[cont-finish.d] executing container finish scripts...
[cont-finish.d] 99-message.sh: executing... 
[cont-finish.d] 99-message.sh: exited 0.
[cont-finish.d] done.
[s6-finish] waiting for services.
[s6-finish] sending all processes the TERM signal.

I’m going to reinstall influxdb, see if that helps.

Hi, i have similar issue with latest HA and Influxdb addon. Influxdb cause HA crash when try to start. At the end i have HA unreachable (even with ssh). In a couple of attempts i had the possibility to see tha influxdb log before ha crash; this is the log…

goroutine 3275 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0x57dfe80, 0x1e9c570, 0xa9f9a40, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0xda24900, 0x57dfe80, 0x1e9c570, 0xa9f9a40, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x4c
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x79c
goroutine 3267 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0x57dfe80, 0x1e9c570, 0xa9f9a40, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0xda24900, 0x57dfe80, 0x1e9c570, 0xa9f9a40, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x4c
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x79c
goroutine 3279 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0x57dfe80, 0x1e9c570, 0xa9f9a40, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0xda24900, 0x57dfe80, 0x1e9c570, 0xa9f9a40, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x4c
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x79c
goroutine 3212 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0x57dfc80, 0x1e9c570, 0xa9f9a10, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0xda24900, 0x57dfc80, 0x1e9c570, 0xa9f9a10, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x4c
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x79c
goroutine 3272 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0x57dfe80, 0x1e9c570, 0xa9f9a40, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0xda24900, 0x57dfe80, 0x1e9c570, 0xa9f9a40, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x4c
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x79c
goroutine 3234 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0x57dfc80, 0x1e9c570, 0xa9f9a10, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0xda24900, 0x57dfc80, 0x1e9c570, 0xa9f9a10, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x4c
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x79c
goroutine 3226 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0x57dfc80, 0x1e9c570, 0xa9f9a10, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0xda24900, 0x57dfc80, 0x1e9c570, 0xa9f9a10, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x4c
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x79c
goroutine 3185 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0x57dfbc0, 0x1e9c570, 0xa9f99e0, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0xda24900, 0x57dfbc0, 0x1e9c570, 0xa9f99e0, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x4c
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x79c
goroutine 3150 [select]:
github.com/influxdata/influxdb/monitor.(*Monitor).storeStatistics(0x4f07320)
	/go/src/github.com/influxdata/influxdb/monitor/service.go:434 +0x578
created by github.com/influxdata/influxdb/monitor.(*Monitor).Open
	/go/src/github.com/influxdata/influxdb/monitor/service.go:126 +0x278
goroutine 3264 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0x57dfe80, 0x1e9c570, 0xa9f9a40, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0xda24900, 0x57dfe80, 0x1e9c570, 0xa9f9a40, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x4c
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x79c
goroutine 3175 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0x57dfbc0, 0x1e9c570, 0xa9f99e0, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0xda24900, 0x57dfbc0, 0x1e9c570, 0xa9f99e0, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x4c
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x79c
goroutine 3174 [chan receive]:
github.com/influxdata/influxdb/services/subscriber.chanWriter.Run(0x57dfbc0, 0x1e9c570, 0xa9f99e0, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:372 +0x38
github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs.func1(0xda24900, 0x57dfbc0, 0x1e9c570, 0xa9f99e0, 0x4f3ece8, 0x4f3ecf0, 0x4feb170)
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:314 +0x4c
created by github.com/influxdata/influxdb/services/subscriber.(*Service).updateSubs
	/go/src/github.com/influxdata/influxdb/services/subscriber/service.go:312 +0x79c
goroutine 3690 [running]:
	goroutine running on other thread; stack unavailable
created by github.com/influxdata/influxdb/tsdb/engine/tsm1.(*Compactor).WriteSnapshot
	/go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/compact.go:858 +0x16c
[s6-finish] sending all processes the KILL signal and exiting.

My question is: if i uninstall influxdb addon to reinstall it again, my existing db will be lost?

Unfortunately I think it will be lost if you reinstall.
At least that is what happened when I did it. I’m sure there is some way to avoid loosing the data, but that is beyond my skills.

Mmmh i’m really disappointed with influxdb. It crashed without reason after only 6 months… Before i used standard HA db for over 1 year without issues… It is not reliable…

1 Like