Skip to content

Commit 5a536cf

Browse files
SeanNarencarmocca
andauthored
Update pytorch_lightning/plugins/training_type/deepspeed.py
Co-authored-by: Carlos Mocholí <[email protected]>
1 parent 973b43c commit 5a536cf

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

pytorch_lightning/plugins/training_type/deepspeed.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -136,7 +136,7 @@ def __init__(
136136
0.0 results in dynamic loss scaling, otherwise static (Default: 0)
137137
138138
initial_scale_power: Power of the initial dynamic loss scale value. Loss scale is computed
139-
by 2^initial_scale_power (Default 32)
139+
by ``2^initial_scale_power`` (Default: 32)
140140
141141
loss_scale_window: Window in which to raise/lower the dynamic FP16 loss scaling value (Default: 1000)
142142

0 commit comments

Comments
 (0)