Neural Magic's software accelerates deep learning inference on CPU-based servers — no GPU required. They use automated model sparsification (pruning + quantization) to compress models so inference runs efficiently on commodity CPUs.
Akamai and Neural Magic share MIT origins. Both HQ'd in Cambridge, Massachusetts.