https://github.com/microsoft/DeepSpeed/blob/master/docs/_tutorials/inference-tutorial.md