-
Notifications
You must be signed in to change notification settings - Fork 6.5k
trained_betas ignored in some schedulers
#635
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
trained_betas ignored in some schedulers
#635
Conversation
|
The documentation is not available anymore as the PR was closed or merged. |
trained_betas ignored in some schedulers
|
This does look like a bug to me, when Requesting review from others in case I'm missing something. |
|
@vishnu-anirudh nice catch! |
|
Although the issue still remains if trained betas and schedule type is passed no? |
From the code, it seems we choose |
|
I think we are intertwining two things here:
This PR looks good to me :-) |
|
Hello (cc @patrickvonplaten) Thanks in advance. |
* correcting the beta value assignment * updating DDIM and LMSDiscreteFlax schedulers * bringing back the changes that were lost as part of main branch merge
* correcting the beta value assignment * updating DDIM and LMSDiscreteFlax schedulers * bringing back the changes that were lost as part of main branch merge
Hello
I was going through the code repo and I observed how the
self.betasis being assigned. I don't know if what I observed is correct, so I wanted to raise this PR to clarify this.Without the changes made in this PR, it seems the following code is not useful
This is because
self.betasis assigned again as part of the if-statement below. And ifbeta_scheduledoesn't exist then an error is raised. So it doesn't matter ifself.betasis assigned totrained_betas.As a note, certain schedulers such as FlaxDDIMScheduler, DDPMScheduler and FlaxDDPMScheduler seem to have the right implementation.
If you think this is not right, I am happy to close this PR.