Skip to content

MultiOptimizer is not serializable. #2731

@Hongbo-F

Description

@Hongbo-F

The current implementation of MultiOptimizer puts grads and vars inside the optimizer_specs variable. Since the grads and vars are not serializable, any model that uses MultiOptimizer class cannot be saved or checkpointed. This PR will only extract the necessary optimizer_specs components that are useful for re-instantiating the MultiOptimizer instance inside get_config() method, leading to a serializable MultiOptimizer implementation.

#2719

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions