Growing Pains: Scaling Deep Learning Inference

Training an effective deep neural network is one thing, but deploying it in a way that keeps up with customer demand and is both performant and cost-efficient is hard. We’ve combined a heavily optimized software stack with deep learning-enabled hardware to fix that.

Source: Growing Pains: Scaling Deep Learning Inference