Skip to content

Commit 2911102

Browse files
committed
Update broadcast call in model dispatch
1 parent 566e4ce commit 2911102

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

pytorch_lightning/overrides/fairscale.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -61,8 +61,8 @@ def state_dict(self) -> Dict[str, Any]:
6161

6262
class LightningModelDispatch(ModelDispatch):
6363
def forward(self, *inputs, **kwargs): # type: ignore
64-
if self.broadcast_buffers and len(list(self.base_model.buffers())) > 0:
65-
self.sync_buffers()
64+
if self.broadcast_model_buffers:
65+
self.sync_buffers(non_blocking=False)
6666
if self.base_model.training:
6767
output = self.base_model.training_step(*inputs, **kwargs)
6868
elif self.base_model.testing:

0 commit comments

Comments
 (0)