NeuralFlix
How Well Do Sparse Models Transfer?
Presenter: Mark Kurtz
In this webinar recording, we summarize our 2022 CVPR-accepted "How Well Do Sparse Imagenet Models Transfer" paper and our 2022 ENLP-accepted "The Optimal BERT Surgeon" paper. We show that sparse models can match or even outperform the transfer performance of dense models, even at high sparsities, and, while doing so, can lead to significant inference and even training speedups.