Skip to content

Commit 20913f5

Browse files
author
SeanNaren
committed
Add reference
1 parent a606cc1 commit 20913f5

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

docs/source/advanced/multi_gpu.rst

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -940,6 +940,8 @@ This saves memory when training larger models however requires using a checkpoin
940940
trainer.fit(model)
941941
942942
943+
.. _deepspeed-zero-stage-3-tips:
944+
943945
DeepSpeed ZeRO Stage 3 Tips
944946
"""""""""""""""""""""""""""
945947

0 commit comments

Comments
 (0)