Skip to content
This repository was archived by the owner on Mar 21, 2024. It is now read-only.

Conversation

@ant0nsc
Copy link
Contributor

@ant0nsc ant0nsc commented Jul 27, 2021

In #531, we accidentally removed pl_find_unused_parameters. Undoing that.

@ant0nsc ant0nsc requested a review from melanibe July 27, 2021 11:01
melanibe
melanibe previously approved these changes Jul 27, 2021
melanibe
melanibe previously approved these changes Jul 27, 2021
accelerator = "ddp" if effective_num_gpus > 1 else None
if effective_num_gpus > 1:
accelerator: Optional[str] = "ddp"
# Initialize the DDP plugin with find_unused_parameters=False by default. If True (default), it prints out
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the comment is a bit confusing for me, the default seems to be indicated 2 times with opposite values. Does this should be interpreted as suggestion to set pl_find_unused_parameters=False in the container? if yes I would slightly change as below.

Suggested change
# Initialize the DDP plugin with find_unused_parameters=False by default. If True (default), it prints out
# Initialize the DDP plugin with find_unused_parameters=False. If True (default), it prints out

Also, for my own understanding, where the user is setting up this default value for the container? maybe a comment there would help too?

@ant0nsc ant0nsc merged commit 988d9fa into main Jul 27, 2021
@ant0nsc ant0nsc deleted the antonsc/find_unused branch July 27, 2021 15:14
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants