on_before_zero_grad hook

[sebastienwood]

📚 Documentation

The documentation report the method on_before_zero_grad. Strangely, this method is not shown in the lifecycle for hooks documentation. Moreover, when it is defined in a lightning module it is not called.

Hence the question : is it a discontinued hook ? If so we could erase its mention in the docs.

Thanks.

[github-actions]

Hi! thanks for your contribution!, great first issue!

[awaelchli]

Hi, thanks for catching that!
I added it in #1483 . Do you see any other hooks missing from the lifecycle?

[sebastienwood]

@awaelchli not that I know !
It seems however that this particular hook is not called. Tried a few experiments and never reached it. The codebase doesn't seem to call it either.