pip install torch torchvision You will also need to install updated DeepSpeed version (>0.7.0), which contains the compression library.

The python code is modified based on (https://github.com/microsoft/DeepSpeedExamples/tree/master/cifar). The key added feature is the compression pipeline.

• config: This folder provides DeepSpeed configuration, including quantization, pruning and layer reduction.

• run_compress.sh This bash script contains jobs for training a checkpoint and then compressing this checkpoint. See more descriptions and results in our tutorial page.