NeuralFlix
YOLOv5 on CPUs: Sparsifying to Achieve GPU-Level Performance and Tiny Footprint
Presenter:
Comparing runs of sparsified (pruned and INT8 quantized) YOLOv5 object detection model running on DeepSparse Inference Runtime and ONNX Runtime.
Setup: Laptop deployment using a 4-core Lenovo Yoga 1.30GHz Intel i7-1065G7