Skip to content

pipeline.rst

Latest commit

 

History

History
24 lines (18 loc) · 462 Bytes

pipeline.rst

File metadata and controls

24 lines (18 loc) · 462 Bytes

Pipeline Parallelism

Model Specification

.. autoclass:: deepspeed.pipe.PipelineModule
    :members:


.. autoclass:: deepspeed.pipe.LayerSpec
    :members:


.. autoclass:: deepspeed.pipe.TiedLayerSpec
    :members:

Training

.. automodule:: deepspeed.runtime.pipe.engine
    :members:

Extending Pipeline Parallelism

.. automodule:: deepspeed.runtime.pipe.schedule
    :members: