Hi! So I’m considering…maybe having an NPU or something similar to be hooked to my proxmox server, which runs in a mini PC. It’s a EliteDesk 800 micro form factor. It has a Core i5 8500 CPU, which at the moment of purchase was good enough for live encoding HEVC video on Jellyfin…that was my main concern back then. But I’d like to consider the possibility of hooking maybe some docker instances or other containers to some local-only AI acceleration. Is there any NPU or cheap GPU I could hook on USB to this proxmox server to run? Has it been done before?
Thanks!
QuickSync is the GPU hardware used to infer from vino models.
https://docs.frigate.video/configuration/hardware_acceleration_video/#via-quicksync
Thx! That’s the video decoding page, though. The thing that decodes the video stream and makes individual images from the stream, for the actual processing. Seems the thing that does inference / object detection is called OpenVINO.
https://docs.frigate.video/configuration/hardware_acceleration_enrichments
Oops, you’re right. Still the QuickShnc GPU doing the detector work, though.
https://docs.frigate.video/frigate/hardware/