Skip to content

Conversation

@patrickvonplaten
Copy link
Contributor

@patrickvonplaten patrickvonplaten commented Dec 29, 2022

It seems like cpu_offload + device_map="auto" currently doesn't work well with accelerate. Remove device_map="auto".

@patrickvonplaten patrickvonplaten merged commit 03bf877 into main Dec 29, 2022
@patrickvonplaten patrickvonplaten deleted the correct_failing_offload_test branch December 29, 2022 13:47
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants