Gaurav Rao

What deep learning models are in the Neural Magic Model Repo?

Gaurav Rao

Last updated: November 17, 2020

The Neural Magic Model Repo includes pre-trained, performance-optimized models ready to use for your machine learning projects

The Model Repo features models sparsified with the latest pruning techniques to deliver exceptional performance on CPUs, and accelerates the process of deploying those models in production.

Currently, teams can choose from a growing library of popular image classification models in the table below. More models are being added regularly. Unlike other repositories, Neural Magic already did the hard work of building, pruning, and re-training the models for immediate use in production.

Existing models from the Neural Magic Model Repo can be transfer-learned with customers’ data, and then recalibrated. This approach makes it easier for teams to use Neural Magic pre-optimized models with their own data, in their own environments.

There are three available types*:

  • Base: The baseline model (standard training process).
  • Recal: A model that is recalibrated for performance optimization on the Neural Magic Inference Engine. This model achieves ~100% of baseline validation metrics.
  • Recal-perf: A model that is recalibrated for performance optimization on the Neural Magic Inference Engine. This model achieves ~99% of baseline validation metrics.
ArchitectureDatasetAvailable Types*FrameworksValidation Baseline Metric
(top1 accuracy)
EfficientNet-B0ImageNetbase, recal-perfONNX, PyTorch77.30%
EfficientNet-B4ImageNetbase, recal-perfONNX, PyTorch83.00%
Inception-v3ImageNetbase, recal, recal-perfONNX, PyTorch77.45%
MnistNetMNISTbaseONNX, PyTorch, TensorFlow~99.00%
MobileNetV1ImageNetbase, recal, recal-perfONNX, PyTorch, TensorFlow70.90%
MobileNetV2ImageNetbaseONNX, PyTorch, TensorFlow71.88%
MobileNetV2-SSDLiteCOCObaseONNX, PyTorch35.7% [email protected]
MobileNetV2-SSDLiteVOCbaseONNX, PyTorch43.5% [email protected]
ResNet-18ImageNetbase, recalONNX, PyTorch, TensorFlow69.80%
ResNet-34ImageNetbase, recalONNX, PyTorch, TensorFlow73.30%
ResNet-50ImageNetbase, recal, recal-perfONNX, PyTorch, TensorFlow76.10%
ResNet-50-SSD-300COCObase, recal-perfONNX, PyTorch42.70% [email protected]
ResNet-50-SSD-300VOCbase, recal-perfONNX, PyTorch52.20% [email protected]
ResNet-50 2xwidthImageNetbaseONNX, PyTorch78.51%
ResNet-101ImageNetbase, recal, recal-perfONNX, PyTorch, TensorFlow77.37%
ResNet-101 2xwidthImageNetbaseONNX, PyTorch78.84%
ResNet-152ImageNetbase,recal-perfONNX, PyTorch, TensorFlow78.31%
VGG-11ImageNetbase,recal-perfONNX, PyTorch, TensorFlow69.02%
VGG-11-BNImageNetbaseONNX, PyTorch, TensorFlow70.38%
VGG-13ImageNetbaseONNX, PyTorch, TensorFlow69.93%
VGG-13-BNImageNetbaseONNX, PyTorch, TensorFlow71.55%
VGG-16ImageNetbase, recal, recal-perfONNX, PyTorch, TensorFlow71.59%
VGG-16-BNImageNetbaseONNX, PyTorch, TensorFlow71.55%
VGG-19ImageNetbase,recal-perfONNX, PyTorch, TensorFlow72.38%
VGG-19-BNImageNetbaseONNX, PyTorch, TensorFlow74.24%
YOLOv3COCObase,recal-perfONNX, PyTorch68.6% [email protected]

More models are added regularly. Contact us to learn more and to get access to the Neural Magic Model Repo.