Feature/colossalai

[Fazziekey]

• support ColossalAI Dream blooth training
• add README for Train ColossalAI Dream blooth

[HuggingFaceDocBuilderDev]

The documentation is not available anymore as the PR was closed or merged.

[isamu-isozaki]

Nice! dreambooth with 6gb gpu is pretty impressive. How fast is it to train on a 6gb card?

[patrickvonplaten]

Hey @Fazziekey,

Could you run make style here to fix the final failing tests? :-)

Also, could we maybe to begin with put this under the research examples as we don't (yet) have that much experience with ColossalAI, e.g. could you maybe create a directory:

examples/research_projects/colossalai_dreambooth here: https://github.com/huggingface/diffusers/tree/main/examples/research_projects with a nice README stating that it is maintained by you? :-)

Apart from this the PR looks very nice to me! @patil-suraj what do you think?

[Fazziekey]

Hey @Fazziekey,

Could you run make style here to fix the final failing tests? :-)

Also, could we maybe to begin with put this under the research examples as we don't (yet) have that much experience with ColossalAI, e.g. could you maybe create a directory:

examples/research_projects/colossalai_dreambooth here: https://github.com/huggingface/diffusers/tree/main/examples/research_projects with a nice README stating that it is maintained by you? :-)

Apart from this the PR looks very nice to me! @patil-suraj what do you think?

ok, I will fix the style bug. and you means I should put the code here? https://github.com/huggingface/diffusers/tree/main/examples/research_projects

[Fazziekey]

@patrickvonplaten @isamu-isozaki I have fixed the format bug, is it ok to be merged or I'd better move it to https://github.com/huggingface/diffusers/tree/main/examples/research_projects

[Fazziekey]

• cpu mode :4GB
  

• auto mode 5.6GB:
  

• cuda mode 11GB:
  

[patil-suraj]

Hey @Fazziekey , this is very cool; thanks a lot for working on this!

As Patrick said, could you please put the script under https://github.com/huggingface/diffusers/tree/main/examples/research_projects ? We could create a dir called colossalai and put the script under it. Then it should be good to merge.

[Fazziekey]

@patil-suraj Hello I have moved the code to https://github.com/huggingface/diffusers/tree/main/examples/research_projects

[Fazziekey]

@patrickvonplaten can you merge the PR

[patrickvonplaten]

Perfect, thank you :-)