Hello

YOLOv3 on CPUs: Sparsifying to Achieve GPU-Level Performance

Use CPUs to decrease costs and increase deployment flexibility while still achieving GPU-class performance. In this post, we elaborate on how we used state-of-the-art pruning and quantization techniques to improve the performance of the YOLOv3 on CPUs. We’ll show that by leveraging the robust YOLO training framework from Ultralytics with SparseML’s sparsification recipes it is… Read More YOLOv3 on CPUs: Sparsifying to Achieve GPU-Level Performance

Neural Magic 1.4 Product Release

We are excited to announce the Neural Magic 1.4 product release. This milestone contains new product features, an improved user experience, and stability enhancements that will simplify the ability for our clients to achieve GPU-class performance on commodity CPUs. NEW – Introducing Sparsify BETA Experience driven tooling to simplify the process of analyzing and optimizing… Read More Neural Magic 1.4 Product Release

Neural Magic 1.2 Product Release

We are excited to announce the Neural Magic 1.2 product release. This product milestone contains new feature updates, an improved user experience, and stability enhancements that will simplify the ability for our clients to achieve price performance on commodity CPUs.  Neural Magic Inference Engine Enables clients to run mission critical deep learning models on commodity… Read More Neural Magic 1.2 Product Release

Speeding Up Memory-Bound Object Detection Models: MobileNetV2_SSD

TL;DR: Learn more about increasing performance for MobileNetV2_SSD models, via pruning and decreasing post-production time. Read time: 3 minutes, 15 seconds In many object detection scenarios, there’s not a moment to lose. A fraction of a second can mean the difference between a self-driving car hitting a dog crossing the street or narrowly missing it.… Read More Speeding Up Memory-Bound Object Detection Models: MobileNetV2_SSD

Neural Magic 1.1 Product Release

We are excited to announce the Neural Magic 1.1 product release. This product milestone contains new feature updates, an improved user experience, and stability enhancements that will simplify the ability for our clients to achieve GPU-class performance on commodity CPUs.  Neural Magic Inference Engine Enables clients to run mission critical deep learning models on commodity… Read More Neural Magic 1.1 Product Release