NeuralFlix

Sparse Transferring Hugging Face Models With SparseML

Presenter: Ricky Costa

In this tutorial, we explore the world of sparse transfer learning as it relates to transformer NLP models. Sparse transfer learning is an optimization technique that allows anyone to take machine learning models and convert them into smaller, faster, and in some cases even more accurate models than their dense variants.

You can follow along with this Colab Notebook.

In this tutorial, we:

    • Sparse transfer a dense BERT model previously finetuned on the emotion dataset, and convert it into a pruned-quantized oBERT model from the Neural Magic SparseZoo.
    • Highlight all of the important points of how to do the training.
    • Benchmark sparse and dense model variations for accuracy and speed using DeepSparse, an inference runtime.

More Videos

Pruning and Quantizing ML Models With One Shot Without Retraining
Sparse Transferring Hugging Face Models With SparseML
Apply Second-Order Pruning Algorithms for SOTA Model Compression
Performant and Cost-Effective Machine Learning At Scale
Sparse Training of Neural Networks Using AC/DC
How Well Do Sparse Models Transfer?
How to Achieve the Fastest CPU Inference Performance for Object Detection YOLO Models
Workshop: How to Optimize Deep Learning Models for Production
How to Compress Your BERT NLP Models For Very Efficient Inference
Sparsifying YOLOv5 for 10x Better Performance, 12x Smaller File Size, and Cheaper Deployment
Tissue vs. Silicon: The Future of Deep Learning Hardware
YOLOv5 on CPUs: Sparsifying to Achieve GPU-Level Performance and Tiny Footprint
YOLOv3 on the Edge: DeepSparse Engine vs. PyTorch
State-of-the-Art NLP Compression Research in Action: Understanding Crypto Sentiment
3.5x Faster NLP BERT Using a Sparsity-Aware Inference Engine on AMD Milan-X
Pruning Deep Learning Models for Success in Production
Accelerate NLP Tasks With Sparsity and the DeepSparse Runtime
Accelerate Image Classification Tasks With Sparsity and the DeepSparse Runtime
Accelerate Image Segmentation Tasks With Sparsity and the DeepSparse Runtime
Accelerate Object Detection Tasks With Sparsity and the DeepSparse Runtime
Intro to SparseZoo
Intro to SparseML
Intro to DeepSparse Runtime
Intro to Neural Magic & Software-Delivered AI
Intro to Deep Learning Model Sparsification

Get more info about

Sparse Transferring Hugging Face Models With SparseML