DNS not running, weird messages in protocols: error relocation /bin/bash

I do have HA running for years on a HA blue device (= Odroid board) using a gazillion of addons. Until a few days the system was running just fine.

Upgrade to HA Core 2024.3.0 consistently fails. To protocal logs indicate some networking issue.

Digging deeper I found out that the internal DNS container (Package aarch64-hassio-dns · GitHub) is not running.

System|Protocols|DNS shows weird messages :

s6-rc: info: service s6rc-oneshot-runner: starting
s6-rc: info: service s6rc-oneshot-runner successfully started
s6-rc: info: service fix-attrs: starting
s6-rc: info: service fix-attrs successfully started
s6-rc: info: service legacy-cont-init: starting
cont-init: info: running /etc/cont-init.d/corefile.sh
Error loading shared library libreadline.so.8: Exec format error (needed by /bin/bash)
Error relocating /bin/bash: unstifle_history: symbol not found
Error relocating /bin/bash: rl_make_bare_keymap: symbol not found
Error relocating /bin/bash: rl_bind_key_if_unbound_in_map: symbol not found
Error relocating /bin/bash: rl_macro_dumper: symbol not found
Error relocating /bin/bash: previous_history: symbol not found
Error relocating /bin/bash: rl_vi_end_word: symbol not found
Error relocating /bin/bash: rl_parse_and_bind: symbol not found
Error relocating /bin/bash: rl_redisplay: symbol not found
Error relocating /bin/bash: rl_push_macro_input: symbol not found
Error relocating /bin/bash: rl_bind_key_in_map: symbol not found
Error relocating /bin/bash: clear_history: symbol not found
Error relocating /bin/bash: add_history: symbol not found
Error relocating /bin/bash: rl_redraw_prompt_last_line: symbol not found
Error relocating /bin/bash: rl_filename_completion_function: symbol not found
Error relocating /bin/bash: rl_function_of_keyseq_len: symbol not found
Error relocating /bin/bash: history_get: symbol not found
Error relocating /bin/bash: rl_get_keymap: symbol not found
Error relocating /bin/bash: rl_kill_text: symbol not found
Error relocating /bin/bash: remove_history: symbol not found
Error relocating /bin/bash: history_truncate_file: symbol not found
Error relocating /bin/bash: rl_generic_bind: symbol not found
Error relocating /bin/bash: rl_read_key: symbol not found
Error relocating /bin/bash: read_history: symbol not found
Error relocating /bin/bash: rl_add_defun: symbol not found
Error relocating /bin/bash: history_expand: symbol not found
Error relocating /bin/bash: rl_newline: symbol not found
Error relocating /bin/bash: rl_translate_keyseq: symbol not found
Error relocating /bin/bash: rl_forced_update_display: symbol not found
Error relocating /bin/bash: rl_set_timeout: symbol not found
Error relocating /bin/bash: rl_read_init_file: symbol not found
Error relocating /bin/bash: rl_insert: symbol not found
Error relocating /bin/bash: rl_invoking_keyseqs: symbol not found
Error relocating /bin/bash: append_history: symbol not found
Error relocating /bin/bash: free_history_entry: symbol not found
Error relocating /bin/bash: rl_unbind_key_in_map: symbol not found
Error relocating /bin/bash: rl_set_signals: symbol not found
Error relocating /bin/bash: readline: symbol not found
Error relocating /bin/bash: rl_variable_value: symbol not found
Error relocating /bin/bash: history_set_pos: symbol not found
Error relocating /bin/bash: rl_unbind_function_in_map: symbol not found
Error relocating /bin/bash: read_history_range: symbol not found
Error relocating /bin/bash: history_is_stifled: symbol not found
Error relocating /bin/bash: rl_menu_complete: symbol not found
Error relocating /bin/bash: stifle_history: symbol not found
Error relocating /bin/bash: replace_history_entry: symbol not found
Error relocating /bin/bash: rl_insert_text: symbol not found
Error relocating /bin/bash: rl_get_keymap_by_name: symbol not found
Error relocating /bin/bash: rl_set_screen_size: symbol not found
Error relocating /bin/bash: rl_clear_signals: symbol not found
Error relocating /bin/bash: rl_vi_bWord: symbol not found
Error relocating /bin/bash: rl_get_termcap: symbol not found
Error relocating /bin/bash: rl_begin_undo_group: symbol not found
Error relocating /bin/bash: rl_ding: symbol not found
Error relocating /bin/bash: where_history: symbol not found
Error relocating /bin/bash: rl_delete_text: symbol not found
Error relocating /bin/bash: rl_function_of_keyseq: symbol not found
Error relocating /bin/bash: rl_bind_keyseq: symbol not found
Error relocating /bin/bash: rl_reset_terminal: symbol not found
Error relocating /bin/bash: history_tokenize: symbol not found
Error relocating /bin/bash: rl_forward_word: symbol not found
Error relocating /bin/bash: rl_copy_text: symbol not found
Error relocating /bin/bash: rl_function_dumper: symbol not found
Error relocating /bin/bash: _rl_find_next_mbchar: symbol not found
Error relocating /bin/bash: rl_vi_insertion_mode: symbol not found
Error relocating /bin/bash: rl_end_undo_group: symbol not found
Error relocating /bin/bash: rl_variable_bind: symbol not found
Error relocating /bin/bash: rl_named_function: symbol not found
Error relocating /bin/bash: rl_initialize: symbol not found
Error relocating /bin/bash: rl_vi_start_inserting: symbol not found
Error relocating /bin/bash: rl_complete: symbol not found
Error relocating /bin/bash: rl_complete_internal: symbol not found
Error relocating /bin/bash: history_list: symbol not found
Error relocating /bin/bash: tilde_expand: symbol not found
Error relocating /bin/bash: rl_funmap_names: symbol not found
Error relocating /bin/bash: rl_set_keymap: symbol not found
Error relocating /bin/bash: rl_variable_dumper: symbol not found
Error relocating /bin/bash: rl_bind_keyseq_in_map: symbol not found
Error relocating /bin/bash: write_history: symbol not found
Error relocating /bin/bash: rl_on_new_line: symbol not found
Error relocating /bin/bash: rl_clear_visible_line: symbol not found
Error relocating /bin/bash: rl_completion_matches: symbol not found
Error relocating /bin/bash: rl_completion_mode: symbol not found
Error relocating /bin/bash: rl_add_undo: symbol not found
Error relocating /bin/bash: rl_cleanup_after_signal: symbol not found
Error relocating /bin/bash: rl_list_funmap_names: symbol not found
Error relocating /bin/bash: using_history: symbol not found
Error relocating /bin/bash: history_get_time: symbol not found
Error relocating /bin/bash: remove_history_range: symbol not found
Error relocating /bin/bash: rl_crlf: symbol not found
Error relocating /bin/bash: rl_trim_arg_from_keyseq: symbol not found
Error relocating /bin/bash: history_length: symbol not found
Error relocating /bin/bash: rl_completion_found_quote: symbol not found
Error relocating /bin/bash: rl_completion_type: symbol not found
Error relocating /bin/bash: rl_point: symbol not found
Error relocating /bin/bash: history_lines_written_to_file: symbol not found
Error relocating /bin/bash: history_max_entries: symbol not found
Error relocating /bin/bash: history_write_timestamps: symbol not found
Error relocating /bin/bash: rl_completion_suppress_quote: symbol not found
Error relocating /bin/bash: rl_basic_word_break_characters: symbol not found
Error relocating /bin/bash: rl_mark: symbol not found
Error relocating /bin/bash: rl_directory_rewrite_hook: symbol not found
Error relocating /bin/bash: rl_emacs_editing_mode: symbol not found
Error relocating /bin/bash: rl_end: symbol not found
Error relocating /bin/bash: rl_directory_completion_hook: symbol not found
Error relocating /bin/bash: rl_completer_word_break_characters: symbol not found
Error relocating /bin/bash: rl_dispatching: symbol not found
Error relocating /bin/bash: rl_filename_completion_function: symbol not found
Error relocating /bin/bash: rl_filename_quoting_desired: symbol not found
Error relocating /bin/bash: history_search_delimiter_chars: symbol not found
Error relocating /bin/bash: rl_executing_keyseq: symbol not found
Error relocating /bin/bash: rl_key_sequence_length: symbol not found
Error relocating /bin/bash: rl_filename_dequoting_function: symbol not found
Error relocating /bin/bash: rl_filename_rewrite_hook: symbol not found
Error relocating /bin/bash: rl_filename_stat_hook: symbol not found
Error relocating /bin/bash: rl_tilde_expand: symbol not found
Error relocating /bin/bash: vi_insertion_keymap: symbol not found
Error relocating /bin/bash: rl_newline: symbol not found
Error relocating /bin/bash: rl_vi_editing_mode: symbol not found
Error relocating /bin/bash: rl_prep_term_function: symbol not found
Error relocating /bin/bash: rl_menu_completion_entry_function: symbol not found
Error relocating /bin/bash: rl_attempted_completion_function: symbol not found
Error relocating /bin/bash: history_comment_char: symbol not found
Error relocating /bin/bash: rl_username_completion_function: symbol not found
Error relocating /bin/bash: rl_insert: symbol not found
Error relocating /bin/bash: rl_filename_completion_desired: symbol not found
Error relocating /bin/bash: rl_done: symbol not found
Error relocating /bin/bash: rl_tab_insert: symbol not found
Error relocating /bin/bash: rl_completion_append_character: symbol not found
Error relocating /bin/bash: rl_sort_completion_matches: symbol not found
Error relocating /bin/bash: history_lines_read_from_file: symbol not found
Error relocating /bin/bash: emacs_ctlx_keymap: symbol not found
Error relocating /bin/bash: rl_deprep_term_function: symbol not found
Error relocating /bin/bash: rl_editing_mode: symbol not found
Error relocating /bin/bash: tilde_additional_prefixes: symbol not found
Error relocating /bin/bash: rl_menu_complete: symbol not found
Error relocating /bin/bash: history_subst_char: symbol not found
Error relocating /bin/bash: rl_readline_state: symbol not found
Error relocating /bin/bash: rl_attempted_completion_over: symbol not found
Error relocating /bin/bash: vi_movement_keymap: symbol not found
Error relocating /bin/bash: rl_filename_quote_characters: symbol not found
Error relocating /bin/bash: rl_filename_quoting_function: symbol not found
Error relocating /bin/bash: history_quotes_inhibit_expansion: symbol not found
Error relocating /bin/bash: rl_readline_name: symbol not found
Error relocating /bin/bash: rl_line_buffer: symbol not found
Error relocating /bin/bash: emacs_meta_keymap: symbol not found
Error relocating /bin/bash: rl_char_is_quoted_p: symbol not found
Error relocating /bin/bash: rl_completion_entry_function: symbol not found
Error relocating /bin/bash: rl_last_func: symbol not found
Error relocating /bin/bash: rl_ignore_some_completions_function: symbol not found
Error relocating /bin/bash: rl_completion_invoking_key: symbol not found
Error relocating /bin/bash: rl_instream: symbol not found
Error relocating /bin/bash: tilde_expansion_preexpansion_hook: symbol not found
Error relocating /bin/bash: rl_yank_last_arg: symbol not found
Error relocating /bin/bash: tilde_additional_suffixes: symbol not found
Error relocating /bin/bash: rl_completion_suppress_append: symbol not found
Error relocating /bin/bash: history_inhibit_expansion_function: symbol not found
Error relocating /bin/bash: rl_completer_quote_characters: symbol not found
Error relocating /bin/bash: rl_completion_quote_character: symbol not found
Error relocating /bin/bash: history_base: symbol not found
Error relocating /bin/bash: rl_terminal_name: symbol not found
Error relocating /bin/bash: history_expansion_char: symbol not found
Error relocating /bin/bash: rl_outstream: symbol not found
Error relocating /bin/bash: emacs_standard_keymap: symbol not found
Error relocating /bin/bash: rl_startup_hook: symbol not found
Error relocating /bin/bash: history_quoting_state: symbol not found
Error relocating /bin/bash: rl_signal_event_hook: symbol not found
Error relocating /bin/bash: rl_special_prefixes: symbol not found
Error relocating /bin/bash: rl_explicit_arg: symbol not found
Error relocating /bin/bash: rl_num_chars_to_read: symbol not found
Error relocating /bin/bash: rl_completion_mark_symlink_dirs: symbol not found
Error relocating /bin/bash: rl_complete: symbol not found
cont-init: info: /etc/cont-init.d/corefile.sh exited 127
cont-init: warning: some scripts exited nonzero
s6-rc: warning: unable to start service legacy-cont-init: command exited 1
/run/s6/basedir/scripts/rc.init: warning: s6-rc failed to properly bring all the services up! Check your logs (in /run/uncaught-logs/current if you have in-container logging) for more information.
/run/s6/basedir/scripts/rc.init: fatal: stopping the container.
s6-rc: info: service fix-attrs: stopping
s6-rc: info: service fix-attrs successfully stopped
s6-rc: info: service s6rc-oneshot-runner: stopping
s6-rc: info: service s6rc-oneshot-runner successfully stopped

docker images shows for the dns image:

ghcr.io/home-assistant/aarch64-hassio-dns 2024.03.0 2f47dc109067 2 days ago 67.7MB

Any idea what went wrong here and how to fix it?

Trying to start the container interactively fails as well

docker pull ghcr.io/home-assistant/aarch64-hassio-dns:2024.03.0 /bin/bash

whereas using an earlier version does work

docker pull ghcr.io/home-assistant/aarch64-hassio-dns:2023.06.2

So my assumption is that aarch64-hassio-dns:2024.03.0 has been built with an architecture not compatible with my HA Blue (=Odroid). Can anyone confirm this? Is this to be considered a bug?

Not much help I know, but I’m running ghcr.io/home-assistant/aarch64-hassio-dns:2024.03.0 just fine on my odroid-c2

# uname -a
Linux arm1 6.6.20-haos #1 SMP PREEMPT Wed Mar 13 12:31:26 UTC 2024 aarch64 HAOS
1 Like

I do have a Blue as test device in my fleet here, and I just checked the DNS log on it, it looks good here:

s6-rc: info: service s6rc-oneshot-runner: starting
s6-rc: info: service s6rc-oneshot-runner successfully started
s6-rc: info: service fix-attrs: starting
s6-rc: info: service fix-attrs successfully started
s6-rc: info: service legacy-cont-init: starting
cont-init: info: running /etc/cont-init.d/corefile.sh
cont-init: info: /etc/cont-init.d/corefile.sh exited 0
s6-rc: info: service legacy-cont-init successfully started
s6-rc: info: service legacy-services: starting
services-up: info: copying legacy longrun coredns (no readiness notification)
s6-rc: info: service legacy-services successfully started
.:5553
.:53
CoreDNS-1.8.7
linux/arm64, go1.22.1, a9adfd5-dirty

We’ve moved the DNS plug-in 2024.03.0 to stale earlier this week, if there would be a general failure there would have been much more noise already.

This looks more like an issue on your particular system. I have seen corrupted Docker containers in the past. Unfortunately, Docker has no built-in way to validate/check a locally stored image.

What is the eMMC lifetime used reporting on your device (under Settings > System > Storage)?

What you can try is downgrading the DNS plug-in using:

ha dns update --version 2023.06.2

Use Supervisor repair which prunes dangling images:

ha supervisor repair

Then upgrade again using:

ha dns update --version 2024.03.0
1 Like

Thanks very much for your reply @agners

My eMMC shows 10% - not sure if that means 10% lifetime left or 10% lifetime already spent.

ha dns update --version 2023.06.2

actually helps, other components do have network access again. However after the recommended

ha supervisor repair
ha dns update --version 2024.03.0

I do again get the Error relocating /bin/bash: rl_explicit_arg: symbol not found messages and DNS does not come up.

I’ve tried a

➜  ~ docker pull ghcr.io/home-assistant/aarch64-hassio-dns:2024.03.0
2024.03.0: Pulling from home-assistant/aarch64-hassio-dns
bca4290a9639: Already exists 
ee7def809e83: Already exists 
95287a5f0c8c: Already exists 
7b5635c62496: Already exists 
e660178f56d3: Pull complete 
2196b65dd49e: Pull complete 
ed62ac7e875f: Pull complete 
Digest: sha256:4491b20b40a921ebfd6df421172001531d7cd92d164bdb51be6d56989663b7e3
Status: Downloaded newer image for ghcr.io/home-assistant/aarch64-hassio-dns:2024.03.0
ghcr.io/home-assistant/aarch64-hassio-dns:2024.03.0

I assume one of the layers bca4290a9639, ee7def809e83, 95287a5f0c8c or 7b5635c62496 might be corrupt. Is there a way to simply redownload them?

Interstingly I see the very same issues (Error relocating /bin/bash: xxx: symbol not found) as well in Samba addon version 12.3.1.

For reference: I’ve fixed this by completly wiping out my existing installation and reflashing the MMC on my HA Blue follwoing Common tasks - Operating System - Home Assistant

I the new installtion I’ve applied the lastest full backup. This solved it.