Skip to content

Implement GroupNorm, LayerNorm & InstanceNorm #6

@seanpmorgan

Description

@seanpmorgan

Per the RFC, we need to move layer_norm from contrib to addons:

This will involve restructuring in an OO format by inheriting from base Keras Layer, modifying the code to match those APIs, and modifying test cases to run in TF2.

https://arxiv.org/abs/1607.06450

EDIT: It will make more sense to implement GroupNorm, and then created interfaces for LayerNorm and InstanceNorm

Group Norm: https://arxiv.org/pdf/1803.08494.pdf

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions