Skip to content

Commit 9301a6b

Browse files
thongonaryakihironittaawaelchli
authored
Remove fp16 restriction in the docstring for DeepSpeedStrategy (#13919)
Co-authored-by: Akihiro Nitta <[email protected]> Co-authored-by: awaelchli <[email protected]>
1 parent 7fe5d4b commit 9301a6b

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

src/pytorch_lightning/strategies/deepspeed.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -152,7 +152,8 @@ def __init__(
152152
153153
Arguments:
154154
155-
zero_optimization: Enable ZeRO optimization. This is only compatible with precision=16.
155+
zero_optimization: Enable ZeRO optimization. This is compatible with either `precision=16` or
156+
`precision="bf16"`.
156157
157158
stage: Different stages of the ZeRO Optimizer. 0 is disabled,
158159
1 is optimizer state partitioning, 2 is optimizer+gradient state partitioning,

0 commit comments

Comments
 (0)