deepspeedai/DeepSpeed
stallingDeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
billion-parameterscompressiondata-parallelismdeep-learninggpuinferencemachine-learningmixture-of-experts