Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions docs/source/common/lightning_module.rst
Original file line number Diff line number Diff line change
Expand Up @@ -80,7 +80,7 @@ Notice a few things.
out = net(x)

Thus, to use Lightning, you just need to organize your code which takes about 30 minutes,
(and let's be real, you probably should do anyhow).
(and let's be real, you probably should do anyway).

------------

Expand Down Expand Up @@ -267,8 +267,8 @@ The matching pseudocode is:

Training with DataParallel
~~~~~~~~~~~~~~~~~~~~~~~~~~
When training using a `accelerator` that splits data from each batch across GPUs, sometimes you might
need to aggregate them on the master GPU for processing (dp, or ddp2).
When training using an `accelerator` that splits data from each batch across GPUs, sometimes you might
need to aggregate them on the main GPU for processing (dp, or ddp2).

In this case, implement the `training_step_end` method

Expand Down Expand Up @@ -379,8 +379,8 @@ If you need to do something with all the outputs of each `validation_step`, over

Validating with DataParallel
~~~~~~~~~~~~~~~~~~~~~~~~~~~~
When training using a `accelerator` that splits data from each batch across GPUs, sometimes you might
need to aggregate them on the master GPU for processing (dp, or ddp2).
When training using an `accelerator` that splits data from each batch across GPUs, sometimes you might
need to aggregate them on the main GPU for processing (dp, or ddp2).

In this case, implement the `validation_step_end` method

Expand Down
6 changes: 6 additions & 0 deletions docs/source/extensions/callbacks.rst
Original file line number Diff line number Diff line change
Expand Up @@ -395,6 +395,12 @@ on_keyboard_interrupt
.. automethod:: pytorch_lightning.callbacks.Callback.on_keyboard_interrupt
:noindex:

on_exception
^^^^^^^^^^^^

.. automethod:: pytorch_lightning.callbacks.Callback.on_exception
:noindex:

on_save_checkpoint
^^^^^^^^^^^^^^^^^^

Expand Down