Tensorflow and official docker image - CPU instruction issue

Configuration
9

I messed with this yesterday and it appears to be working, if a bit slow. I use a Synology NAS, which also fails on the default install due to the lack of AVX instruction sets.

Generate a custom wheel using the CPU build.sh method here - https://github.com/hadim/docker-tensorflow-builder

Install the wheel manually within the docker container

pip install tensorflow-1.8.0-cp27-cp27mu-linux_x86_64.whl

Add to HA config

image_processing:
- platform: tensorflow
source:
  - entity_id: camera.motion_front
  - entity_id: camera.motion_frontdoor
  - entity_id: camera.motion_laundry
  - entity_id: camera.motion_laundryback
  - entity_id: camera.motion_backyard
  - entity_id: camera.motion_backdeck
model:
  graph: /config/tensorflow/ssd_mobilenet_v2_coco_2018_03_29/frozen_inference_graph.pb
  categories:
    - person
file_out:
  - "/storagemotion/tensorflow/{{ camera_entity.split('.')[1] }}_latest.jpg"
  - "/storagemotion/tensorflow/{{ camera_entity.split('.')[1] }}_{{ now().strftime('%Y%m%d_%H%M%S') }}.jpg"
scan_interval: 1000000

Then call the service -

image_processing.tensorflow_motion_frontdoor (for example)

It took about 45 seconds to generate though;

2018-11-13 23:16:38 WARNING (MainThread) [homeassistant.helpers.entity] Update of image_processing.tensorflow_motion_frontdoor is taking over 10 seconds
2018-11-13 23:17:13 INFO (SyncWorker_14) [homeassistant.components.image_processing.tensorflow] Saving results image to /storagemotion/tensorflow/motion_frontdoor_latest.jpg
2018-11-13 23:17:13 INFO (SyncWorker_14) [homeassistant.components.image_processing.tensorflow] Saving results image to /storagemotion/tensorflow/motion_frontdoor_20181114_091713.jpg

Here is the result (red box is from Motion, yellow box plus person label is from tensorflow)

motion_frontdoor_20181114_091713

Logs show stuff taking awhile at startup;

2018-11-13 23:15:04 WARNING (SyncWorker_18) [homeassistant.components.image_processing.tensorflow] No OpenCV library found. TensorFlow will process image with PIL at reduced resolution.
2018-11-13 23:15:11 WARNING (MainThread) [homeassistant.components.image_processing] Setup of platform tensorflow is taking over 10 seconds.

So i’m pleased with the result but need a big performance boost before it would be usable

2 Likes