Skip to content

Conversation

@H-Huang
Copy link
Member

@H-Huang H-Huang commented Aug 12, 2024

…tely"


Allows PP to be used without a seed checkpoint by calling `init_weight` on each model part. This is the solution in step 1 of #514 proposed by wconstab 


[ghstack-poisoned]
…del parts separately"


Allows PP to be used without a seed checkpoint by calling `init_weight` on each model part. This is the solution in step 1 of #514 proposed by wconstab 


[ghstack-poisoned]
…tely"


Allows PP to be used without a seed checkpoint by calling `init_weight` on each model part. This is the solution in step 1 of #514 proposed by wconstab 


[ghstack-poisoned]
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Aug 12, 2024
@H-Huang H-Huang changed the base branch from gh/H-Huang/5/base to main August 12, 2024 21:42
H-Huang added a commit that referenced this pull request Aug 12, 2024
Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at
bottom):
* #473
* #517
* __->__ #516

Allows PP to be used without a seed checkpoint by calling `init_weight`
on each model part. This is the solution in step 1 of
#514 proposed by @wconstab
@H-Huang H-Huang merged commit fa7fe1e into main Aug 12, 2024
tianyu-l pushed a commit that referenced this pull request Aug 16, 2024
ghstack-source-id: f9442fe
Pull Request resolved: #517
fegin pushed a commit that referenced this pull request Aug 16, 2024
Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at
bottom):
* #473
* #517
* __->__ #516

Allows PP to be used without a seed checkpoint by calling `init_weight`
on each model part. This is the solution in step 1 of
#514 proposed by @wconstab
fegin pushed a commit that referenced this pull request Aug 16, 2024
Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at
bottom):
* #473
* __->__ #517
* #516

Ran `pre-commit run --all-files`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants