Neural Magic delivers best-in-class deep learning performance on commodity CPUs, via:
- Model optimization techniques like pruning and quantization
- Smart algorithms that utilize CPU memory more effectively.
Schedule a demo on the right! Or see below for our short end-to-end video guides on how to install our software, prepare and run a model for inference, and finally benchmark for performance.
TensorFlow End-to-End Demo:
PyTorch End-to-End Demo:
Neural Magic Model Repo End-to-End Demo: