Exclude parameters from AdamW's weight decaying

[markub3327]

Hello,

I'm working with Transformer and I need to exclude its pos_embed parameters defined in my custom Layer from weight decaying and the remaining parameters will be used during weight decaying (all of them are trainable parameters). This behaviour is implemented here.

Thanks a lot.
Have a nice day.

[markub3327]

Sorry, it's solved here #2624.