Skip to content
This repository was archived by the owner on Sep 23, 2025. It is now read-only.

Conversation

@Deegue
Copy link
Contributor

@Deegue Deegue commented May 30, 2024

Including following models:
"EleutherAI/gpt-j-6b"
"meta-llama/Llama-2-7b-chat-hf"
"mistralai/Mistral-7B-v0.1"
"google/gemma-2b"

@Deegue Deegue changed the title [Finetune] Add finetune gaudi2 workflow [Finetune] Add finetune Gaudi workflow May 30, 2024
docker exec "finetune" bash -c "llm_on_ray-finetune --config_file llm_on_ray/finetune/finetune_gaudi.yaml"
}

denas_lora_test_gaudi(){
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

deltatuner is removed, not supported.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

removed, thanks for review!

docker image prune -f
}

build_and_prune_gaudi() {

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there is no need to duplicate code, could you merge this with build_and_prune

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants