phase 19 · lesson 77 of 85Pipeline Parallel79-pipeline-parallel·full lesson folder ↗mark as completed← previousZero Parameter Shardingcomplete & next →Checkpoint Sharded Resume