Everything we know about memory requirements in machine learning may be wrong. Today, when data scientists process deep learning models using a “throughput computing” device like a GPU, TPU, or similar hardware accelerator, they’re likely faced with a decision to shrink their model or input size to fit within the device’s memory limitations. Training a… Read More Challenging Memory Requirements and Performance Standards in ML
We at Neural Magic have been working on solving complex machine learning problems for years, and together our team comprises several decades of experience in the deep learning space. Since we started Neural Magic, we have spoken to and learned from thousands of Data Scientists and Machine Learning Engineers at conferences, small groups, and one-on-one… Read More Contribute to Neural Magic’s First Annual State of Deep Learning Report
Simply defined, machine learning-based visual search uses images rather than text to deliver results. In retail, for example, consumers can snap a photo of a jacket or purse they see in the real world, and use these photos to locate and purchase the item online. According to a recent Forbes article, the popularity of visual… Read More How to Use Machine Learning in Visual Search for Retail
I would like to put forth an idea that might seem counterintuitive given present-day hype: that human-scale machine learning infrastructures must more closely map to the human brain. In more technical terms, this means that they should be based on modifications to existing commodity Von-Neumann architecture CPUs, rather than on today’s popular “brain-inspired” massively parallel… Read More Counterintuitive Lessons: How to Improve Machine Learning
What are you doing on March 19th of this year? We’ll be at SXSW in Austin, TX, and our very own CEO Nir Shavit will be giving a talk! If you’ll be at SXSW, we hope to see you at his talk. Big Brain Burnout: Nir’s Talk for SXSW Nir will be speaking on the… Read More Neural Magic is Coming to SXSW 2020: What’s Wrong with AI Computing?
Recently, we’ve had the honor of being named to two local lists that celebrate Boston-area companies that demonstrate high growth potential and innovative technology. Boston has always been a hotbed of innovation, with prestigious universities like MIT and Harvard situated here, and a long history of achievement in the sciences, medicine, and technology. It’s not… Read More Built in Boston & Bostinno Honor Neural Magic for Potential
Nir’s take on the future of machine learning—where it’s heading and where it should be heading—can be seen as contrary to the current, prevailing wisdom.
Now you can see what we’ve been working on for the past few months.
Are you heading to NeurIPS in Vancouver this December 8-14th? So are we! And we would love to meet you. Stop by booth #9 and say hello. Who is Neural Magic? Coming out of MIT, Neural Magic is a pure software engine that delivers GPU-class performance when running neural networks on commodity CPUs. Our software… Read More Neural Magic at NeurIPS 2019
We are proud to announce the first version of the Neural Magic Inference Engine, offering GPU-class performance on commodity CPUs.