Coral - USB3 same speed as USB2

Configuration
1

Hi, I run Haos with a proxmox VM on an EliteDesk G3, i5, and 16Gb RAM, and frigate as an addon of HA.
Frigate is running well, the coral TPU recognized, The USB Coral key is configured a USB Passthrough
When I plug it in a USB2 port or USB3 port I have the same Inference speed is 30ms !

I changed the cable, but it didn’t help.

Here the log of Frigate :

2024-02-09 09:47:08.228795967  [2024-02-09 10:47:08] frigate.app                    INFO    : Starting Frigate (0.13.1-34fb1c2)
2024-02-09 09:47:08.229282456  [2024-02-09 10:47:08] frigate.app                    INFO    : Creating directory: /tmp/cache
2024-02-09 09:47:08.302596467  [2024-02-09 10:47:08] peewee_migrate.logs            INFO    : Starting migrations
2024-02-09 09:47:08.308710600  [2024-02-09 10:47:08] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-02-09 09:47:08.343585838  [2024-02-09 10:47:08] frigate.app                    INFO    : Recording process started: 238
2024-02-09 09:47:08.347335044  [2024-02-09 10:47:08] frigate.app                    INFO    : go2rtc process pid: 91
2024-02-09 09:47:08.442717352  [2024-02-09 10:47:08] frigate.app                    INFO    : Output process started: 249
2024-02-09 09:47:08.503490266  [2024-02-09 10:47:08] frigate.app                    INFO    : Camera processor started for front: 259
2024-02-09 09:47:08.509261539  [2024-02-09 10:47:08] frigate.app                    INFO    : Camera processor started for chemin: 260
2024-02-09 09:47:08.516875041  [2024-02-09 10:47:08] frigate.app                    INFO    : Camera processor started for cour: 262
2024-02-09 09:47:08.537140880  [2024-02-09 10:47:08] frigate.app                    INFO    : Camera processor started for champs: 263
2024-02-09 09:47:08.554270366  [2024-02-09 10:47:08] frigate.app                    INFO    : Camera processor started for terrasse: 265
2024-02-09 09:47:08.582755764  [2024-02-09 10:47:08] frigate.app                    INFO    : Capture process started for front: 270
2024-02-09 09:47:08.595441036  [2024-02-09 10:47:08] frigate.app                    INFO    : Capture process started for chemin: 272
2024-02-09 09:47:08.607444892  [2024-02-09 10:47:08] frigate.app                    INFO    : Capture process started for cour: 275
2024-02-09 09:47:08.628859058  [2024-02-09 10:47:08] frigate.app                    INFO    : Capture process started for champs: 279
2024-02-09 09:47:08.666170330  [2024-02-09 10:47:08] frigate.app                    INFO    : Capture process started for terrasse: 286
2024-02-09 09:47:11.460235118  [2024-02-09 10:47:08] detector.coral                 INFO    : Starting detection process: 248
2024-02-09 09:47:11.460238884  [2024-02-09 10:47:08] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2024-02-09 09:47:11.466546029  [2024-02-09 10:47:11] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found

Any Idea ?

2

Im getting 7.54 . Im running Has OS on a bare metal machine. It may be the pass through you have to do on a VM.

3

I have a check box to set when configuring the USB pass-through to use USB3.
I have also enabled a lot of the virtualization settings in the BIOS, which improve the systems access hardware with hypervisors.
The features of the BIOS is quite important for hypervisors.

4

Thans for your replies.
Here is Passthrough setting :
usb

Weird, because it is written “unplugged”.
The others usb devices are my Slaesh zigbee stick ans my mysensors gateway.

5

Just below the dropdown box you have opened on the screenshot you can see the “use USB3” check box, but it looks like it is greyed out.
You might need some drivers or you might need some BIOS settings, if they are available.

6

Yes, I cannot check it.
The issue seems to be a Proxmox 8 usb passthrough issue :
See there : xhci_hcd error | Proxmox Support Forum

7

I use a fully updated proxmox 8 and have no issues, but I run it on a gen 13 Intel NUC that have all the BIOS features available for virtualization on the hardware.

8

I’ve just updated my HP EliteDesk too, but no luck, still having the issue.
The USB is still written “unplugged” even if Frigate recognize the Coral Key.
The Bios seems to be configured correctly too, I enabled the virtualization options.

9

I finally got it, with this workaround :
I installed frigate on a separate container, specially dedicated to my cams.
I used for that the same configuration as in the addon.
I uninstalled the addon, and reconfigured the frigate component to communicate with the container.
The way the container deals with the usb ports is different than in the VMs, and now I finally get an inference speed of 8ms :nerd_face:

10

Correct.
A VM virtualizes the entire system, kernel and user space.
A container only virtualizes the user space.

A container makes you bound to the host OS in some ways though.