Challenging Memory Requirements and Performance Standards in ML

Everything we know about memory requirements in machine learning may be wrong.  Today, when data scientists process deep learning models using a “throughput computing” device like a GPU, TPU, or similar hardware accelerator, they’re likely faced with a decision to shrink their model or input size to fit within the device’s memory limitations. Training a… Read More Challenging Memory Requirements and Performance Standards in ML

Contribute to Neural Magic’s First Annual State of Deep Learning Report

We at Neural Magic have been working on solving complex machine learning problems for years, and together our team comprises several decades of experience in the deep learning space. Since we started Neural Magic, we have spoken to and learned from thousands of Data Scientists and Machine Learning Engineers at conferences, small groups, and one-on-one… Read More Contribute to Neural Magic’s First Annual State of Deep Learning Report

Counterintuitive Lessons: How to Improve Machine Learning

I would like to put forth an idea that might seem counterintuitive given present-day hype: that human-scale machine learning infrastructures must more closely map to the human brain. In more technical terms, this means that they should be based on modifications to existing commodity Von-Neumann architecture CPUs, rather than on today’s popular “brain-inspired” massively parallel… Read More Counterintuitive Lessons: How to Improve Machine Learning

Built in Boston & Bostinno Honor Neural Magic for Potential

Recently, we’ve had the honor of being named to two local lists that celebrate Boston-area companies that demonstrate high growth potential and innovative technology. Boston has always been a hotbed of innovation, with prestigious universities like MIT and Harvard situated here, and a long history of achievement in the sciences, medicine, and technology. It’s not… Read More Built in Boston & Bostinno Honor Neural Magic for Potential

Neural Magic Demo Video

Now you can see what we’ve been working on for the past few months.

Neural Magic at NeurIPS 2019

Are you heading to NeurIPS in Vancouver this December 8-14th? So are we! And we would love to meet you. Stop by booth #9 and say hello. Who is Neural Magic? Coming out of MIT, Neural Magic is a pure software engine that delivers GPU-class performance when running neural networks on commodity CPUs. Our software… Read More Neural Magic at NeurIPS 2019