Per the RFC, we need to move layer_norm from contrib to addons:
This will involve restructuring in an OO format by inheriting from base Keras Layer, modifying the code to match those APIs, and modifying test cases to run in TF2.
https://arxiv.org/abs/1607.06450
EDIT: It will make more sense to implement GroupNorm, and then created interfaces for LayerNorm and InstanceNorm
Group Norm: https://arxiv.org/pdf/1803.08494.pdf