Compile error installing numpy

[jazzyisj (Jason)]

Not sure if I’m in the right spot to get help with this issue but I’ll give it a shot. If anyone has any hints to get me through this I’d be most appreciative. Linux noob here so type slow, but I do take directions well!

I’m trying to install this custom component.

Reviewers needed: Environment Canada component with weather, sensor, and camera (radar) platforms

I’ve submitted my first major pull request, and I’d really appreciate it if more experienced contributors could spare a few minutes to review it. It’s new code to leverage leverage Environment Canada weather data, and includes weather, sensor, and camera platforms, along with a simple component to pull them all together. https://github.com/home-assistant/home-assistant/pull/15353 Thanks in advance!

When I try to install the required dependencies it fails on installing numpy with a compile error. I have also tried to install numpy on its own and I get the same error as outlined in the link below. Anyone have any ideas where the problem lies?

Reviewers needed: Environment Canada component with weather, sensor, and camera (radar) platforms

@michaeldavie Was hoping to take your component here for a preview spin before it gets integrated. When I run this command: pip install env_canada==0.0.8 --target /config/deps/lib/python3.6/site-packages --upgrade I get this error C compiler: gcc -fno-strict-aliasing -Os -fomit-frame-pointer -g -DNDEBUG -Os -fomit-frame-pointer -g -DTHREAD_STACK_SIZE=0x100000 -fPIC compile options: '-Inumpy/core/src/common -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -…

[pnbruckner (Phil)]

Have you figured this out yet?

In general, if a component is written correctly, it will list its requirements in a statement that defines a REQUIREMENTS variable. Then, when HA loads the component, it will automatically install the required packages. You shouldn’t have to do that manually.

[jazzyisj (Jason)]

No I had to put it aside for now. I got as far as figuring out how to run pip from python3 and getting it to run. The install package does download all the dependencies then it fails after installing a couple of them. At first it was numpy, last couple times it was pillow. If I was better with linux in general I could probably figure it out but I still haven’t completely wrapped my head around the whole docker/container/virtual environment thing and then using HASSOS complicates everything on top of that. Can’t afford to spend any more time on it.

I believe this is the author’s first HA component, so it wouldn’t be shocking if there were some issues with it. I was interested in using it if/when it gets pulled into HA so I thought I’d lend a hand and help test it out. Have resigned myself to sit back and wait for his PR to go through but it doesn’t look like there’s been any action on it for a few while now.

Add Environment Canada weather, sensor, and camera platforms

[michaeldavie]

My component was finally merged in 0.95, so please let me know if you’re still having trouble.

[wciinet (Mark)]

Hi there, it seems there are still issues.

I’m using Home Assistant 0.95.4 in venv on Raspbian, and trying to get this component to install has been a bit frustrating.

I had to install libjpeg-dev and libatlas-base-dev to get pillow to install.

Then numpy failed with this error:

2019-07-16 08:54:54 ERROR (MainThread) [homeassistant.components.sensor] Error while setting up platform environment_canada
Traceback (most recent call last):
  File "/srv/homeassistant/lib/python3.7/site-packages/numpy/core/__init__.py", line 40, in <module>
    from . import multiarray
  File "/srv/homeassistant/lib/python3.7/site-packages/numpy/core/multiarray.py", line 12, in <module>
    from . import overrides
  File "/srv/homeassistant/lib/python3.7/site-packages/numpy/core/overrides.py", line 6, in <module>
    from numpy.core._multiarray_umath import (
ImportError: /lib/arm-linux-gnueabihf/libm.so.6: version `GLIBC_2.27' not found (required by /srv/homeassistant/lib/python3.7/site-packages/numpy/core/_multiarray_umath.cpython-37m-arm-linux-gnueabihf.so)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/srv/homeassistant/lib/python3.7/site-packages/homeassistant/helpers/entity_platform.py", line 126, in _async_setup_platform
    SLOW_SETUP_MAX_WAIT)
  File "/usr/local/opt/python-3.7.3/lib/python3.7/asyncio/tasks.py", line 416, in wait_for
    return fut.result()
  File "/usr/local/opt/python-3.7.3/lib/python3.7/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/srv/homeassistant/lib/python3.7/site-packages/homeassistant/components/environment_canada/sensor.py", line 91, in setup_platform
    from env_canada import ECData
  File "/srv/homeassistant/lib/python3.7/site-packages/env_canada/__init__.py", line 1, in <module>
    from .env_canada import *
  File "/srv/homeassistant/lib/python3.7/site-packages/env_canada/env_canada.py", line 9, in <module>
    import imageio
  File "/srv/homeassistant/lib/python3.7/site-packages/imageio/__init__.py", line 22, in <module>
    from .core import FormatManager, RETURN_BYTES
  File "/srv/homeassistant/lib/python3.7/site-packages/imageio/core/__init__.py", line 10, in <module>
    from .util import Image, Array, Dict, asarray, image_as_uint, urlopen
  File "/srv/homeassistant/lib/python3.7/site-packages/imageio/core/util.py", line 27, in <module>
    import numpy as np
  File "/srv/homeassistant/lib/python3.7/site-packages/numpy/__init__.py", line 142, in <module>
    from . import core
  File "/srv/homeassistant/lib/python3.7/site-packages/numpy/core/__init__.py", line 71, in <module>
    raise ImportError(msg)
ImportError: 

IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE!

Importing the multiarray numpy extension module failed.  Most
likely you are trying to import a failed build of numpy.
Here is how to proceed:
- If you're working with a numpy git repository, try `git clean -xdf`
  (removes all files not under version control) and rebuild numpy.
- If you are simply trying to use the numpy version that you have installed:
  your installation is broken - please reinstall numpy.
- If you have already reinstalled and that did not fix the problem, then:
  1. Check that you are using the Python you expect (you're using /srv/homeassistant/bin/python3.7),
     and that you have no directories in your PATH or PYTHONPATH that can
     interfere with the Python and numpy versions you're trying to use.
  2. If (1) looks fine, you can open a new issue at
     https://github.com/numpy/numpy/issues.  Please include details on:
     - how you installed Python
     - how you installed numpy
     - your operating system
     - whether or not you have multiple versions of Python installed
     - if you built from source, your compiler versions and ideally a build log

     Note: this error has many possible causes, so please don't comment on
     an existing issue about this - open a new one instead.

Original error was: /lib/arm-linux-gnueabihf/libm.so.6: version `GLIBC_2.27' not found (required by /srv/homeassistant/lib/python3.7/site-packages/numpy/core/_multiarray_umath.cpython-37m-arm-linux-gnueabihf.so)

Also tried to install numpy (inside the venv) without the binary package like this:

pip3 install numpy --no-cache-dir --force-reinstall --no-binary :all:

Which seems to have HA running without complaint.

[michaeldavie]

Thanks for letting me know. So is it working now that’s you’ve installed it via pip?

[wciinet (Mark)]

Yes it is, however its fair to say that the command line " --no-cache-dir --force-reinstall --no-binary :all:" is what fixed it.

[wciinet (Mark)]

This seems to be back… I upgraded my venv to python 3.9 to prepare for the upcoming depreciation, and had all kinds of problems trying to get opencv-python-headless installed so decided to uninstall the integration until python 3.10 is supported by HA, but got an error (below)

I had to do the source compile of numpy to uninstall the integration.

As a side note is there a way to install the integration without any of the cameras so I can avoid opencv entirely?
*Edit - I re-added the integration and disabled the camera, and it didn’t need opencv.

Here is the error I got when removing it:

Nov 21 07:28:31 rpi04 hass[550]: 2021-11-21 07:28:31 ERROR (MainThread) [aiohttp.server] Error handling request
Nov 21 07:28:31 rpi04 hass[550]: Traceback (most recent call last):
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/numpy/core/__init__.py", line 22, in <module>
Nov 21 07:28:31 rpi04 hass[550]:     from . import multiarray
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/numpy/core/multiarray.py", line 12, in <module>
Nov 21 07:28:31 rpi04 hass[550]:     from . import overrides
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/numpy/core/overrides.py", line 7, in <module>
Nov 21 07:28:31 rpi04 hass[550]:     from numpy.core._multiarray_umath import (
Nov 21 07:28:31 rpi04 hass[550]: ImportError: /lib/arm-linux-gnueabihf/libm.so.6: version `GLIBC_2.29' not found (required by /srv/homeassistant/lib/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-arm-linux-gnueabihf.so)
Nov 21 07:28:31 rpi04 hass[550]: During handling of the above exception, another exception occurred:
Nov 21 07:28:31 rpi04 hass[550]: Traceback (most recent call last):
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/aiohttp/web_protocol.py", line 422, in _handle_request
Nov 21 07:28:31 rpi04 hass[550]:     resp = await self._request_handler(request)
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/aiohttp/web_app.py", line 499, in _handle
Nov 21 07:28:31 rpi04 hass[550]:     resp = await handler(request)
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/aiohttp/web_middlewares.py", line 119, in impl
Nov 21 07:28:31 rpi04 hass[550]:     return await handler(request)
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/http/security_filter.py", line 60, in security_filter_middleware
Nov 21 07:28:31 rpi04 hass[550]:     return await handler(request)
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/http/forwarded.py", line 220, in forwarded_middleware
Nov 21 07:28:31 rpi04 hass[550]:     return await handler(request)
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/http/request_context.py", line 24, in request_context_middleware
Nov 21 07:28:31 rpi04 hass[550]:     return await handler(request)
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/http/ban.py", line 78, in ban_middleware
Nov 21 07:28:31 rpi04 hass[550]:     return await handler(request)
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/http/auth.py", line 138, in auth_middleware
Nov 21 07:28:31 rpi04 hass[550]:     return await handler(request)
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/http/view.py", line 135, in handle
Nov 21 07:28:31 rpi04 hass[550]:     result = await result
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/config/config_entries.py", line 71, in delete
Nov 21 07:28:31 rpi04 hass[550]:     result = await hass.config_entries.async_remove(entry_id)
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/config_entries.py", line 822, in async_remove
Nov 21 07:28:31 rpi04 hass[550]:     await entry.async_remove(self.hass)
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/config_entries.py", line 478, in async_remove
Nov 21 07:28:31 rpi04 hass[550]:     component = integration.get_component()
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/loader.py", line 522, in get_component
Nov 21 07:28:31 rpi04 hass[550]:     cache[self.domain] = importlib.import_module(self.pkg_path)
Nov 21 07:28:31 rpi04 hass[550]:   File "/usr/local/lib/python3.9/importlib/__init__.py", line 127, in import_module
Nov 21 07:28:31 rpi04 hass[550]:     return _bootstrap._gcd_import(name[level:], package, level)
Nov 21 07:28:31 rpi04 hass[550]:   File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
Nov 21 07:28:31 rpi04 hass[550]:   File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
Nov 21 07:28:31 rpi04 hass[550]:   File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
Nov 21 07:28:31 rpi04 hass[550]:   File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
Nov 21 07:28:31 rpi04 hass[550]:   File "<frozen importlib._bootstrap_external>", line 850, in exec_module
Nov 21 07:28:31 rpi04 hass[550]:   File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/homeassistant/components/environment_canada/__init__.py", line 6, in <module>
Nov 21 07:28:31 rpi04 hass[550]:     from env_canada import ECRadar, ECWeather, ec_exc
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/env_canada/__init__.py", line 4, in <module>
Nov 21 07:28:31 rpi04 hass[550]:     from .ec_radar import *
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/env_canada/ec_radar.py", line 11, in <module>
Nov 21 07:28:31 rpi04 hass[550]:     import imageio
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/imageio/__init__.py", line 22, in <module>
Nov 21 07:28:31 rpi04 hass[550]:     from .core.imopen import imopen
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/imageio/core/__init__.py", line 10, in <module>
Nov 21 07:28:31 rpi04 hass[550]:     from .util import Image, Array, Dict, asarray, image_as_uint, urlopen
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/imageio/core/util.py", line 10, in <module>
Nov 21 07:28:31 rpi04 hass[550]:     import numpy as np
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/numpy/__init__.py", line 150, in <module>
Nov 21 07:28:31 rpi04 hass[550]:     from . import core
Nov 21 07:28:31 rpi04 hass[550]:   File "/srv/homeassistant/lib/python3.9/site-packages/numpy/core/__init__.py", line 48, in <module>
Nov 21 07:28:31 rpi04 hass[550]:     raise ImportError(msg)
Nov 21 07:28:31 rpi04 hass[550]: ImportError:
Nov 21 07:28:31 rpi04 hass[550]: IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE!
Nov 21 07:28:31 rpi04 hass[550]: Importing the numpy C-extensions failed. This error can happen for
Nov 21 07:28:31 rpi04 hass[550]: many reasons, often due to issues with your setup or how NumPy was
Nov 21 07:28:31 rpi04 hass[550]: installed.
Nov 21 07:28:31 rpi04 hass[550]: We have compiled some common reasons and troubleshooting tips at:
Nov 21 07:28:31 rpi04 hass[550]:     https://numpy.org/devdocs/user/troubleshooting-importerror.html
Nov 21 07:28:31 rpi04 hass[550]: Please note and check the following:
Nov 21 07:28:31 rpi04 hass[550]:   * The Python version is: Python3.9 from "/srv/homeassistant/bin/python3.9"
Nov 21 07:28:31 rpi04 hass[550]:   * The NumPy version is: "1.21.4"
Nov 21 07:28:31 rpi04 hass[550]: and make sure that they are the versions you expect.
Nov 21 07:28:31 rpi04 hass[550]: Please carefully study the documentation linked above for further help.
Nov 21 07:28:31 rpi04 hass[550]: Original error was: /lib/arm-linux-gnueabihf/libm.so.6: version `GLIBC_2.29' not found (required by /srv/homeassistant/lib/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-arm-linux-gnueabihf.so)

Thanks!