Pruning Deep Learning Models for Success in Production
Research shows that 58% of data scientists are not optimizing their deep learning models for production, despite the significant advantages techniques like pruning and quantization can offer. Why? BECAUSE IT'S HARD!
Mark Kurtz, Machine Learning Lead at Neural Magic, demonstrates how to prune models for performance. He covers an overview of pruning, including its benefits and downsides. He shares easy ways to prune models and showcases tools that make pruning easy and successful. Lastly, Mark shows how to get performance out of a pruned model in production.