Are you aware of any NPU/TPU integrated on a SBC that actually works with frigate/HaOS?
Because I own a s905x3 device with integrated 1.2 TOPS NPU and it is totally useless
opened 02:48PM - 12 Mar 22 UTC
closed 10:47AM - 23 Apr 22 UTC
enhancement
stale
**Describe what you are trying to accomplish and why in non technical terms**
T… he Amlogic S905X3 is a modification of the S905X2 with optionally added Neural Network accelerator with 1.2 TOPS. The A311D has 5 TOPS. Together with their low power consumption and the video hardware acceleration support in the linux kernel, they seem like a really good option for a Frigate system. The documentation of Amlogic says that the NN accelerator has TensorFlow and Coffee support.
Ideally, the system would also be compatible with Coral and the two NN accelerators can run together. That would allow people to buy a cheap device to test Frigate and add a Coral later if more capacity is required. Maybe even Frigate could sell the system to raise some money.
**Describe the solution you'd like**
First, has anyone tried running Frigate on a S905X3 with NN acc. or a A311D already? Second, do the Frigate developers see potential enough in the chipsets to support them? Would the S905X3/A311D NN accelerator and Coral work at the same time?
EDIT: Not advocating for any particular brand, but as example, a device like this would make a very good, quiet and power efficient Frigate system: https://www.khadas.com/vim3
In the end I went with old x64 thin client and coral tpu. The performance boost over all is amazing and I got it shipped used for $50 with everything in the box.
