Environment Installation Problems

[hushyangqing]

I have encountered a lot problem during environment installation.

1. whether conda or python virtual env should be used
2. When I use conda for the pip install -e ./verl, disk quota exceeded error occur. So I turn to pip install --no-cache-dir -e ./verl. However for the command pip install -e ., package conflicting occur

hydra-core 1.3.2 requires antlr4-python3-runtime==4.9., but you have antlr4-python3-runtime 4.7.2 which is incompatible.
omegaconf 2.3.0 requires antlr4-python3-runtime==4.9., but you have antlr4-python3-runtime 4.7.2 which is incompatible.
But there are other packages that need antlr4-python3-runtime 4.7.2.

3. When I used python virtual env, I encountered other version problem

ERROR: Could not find a version that satisfies the requirement flash_attn==2.7.3 (from deepscaler) (from versions: 0.2.0, 0.2.1, 0.2.2, 0.2.3, 0.2.4, 0.2.5, 0.2.6.post1, 0.2.7, 0.2.8, 1.0.0, 1.0.1, 1.0.2, 1.0.3, 1.0.3.post0, 1.0.4, 1.0.5, 1.0.6, 1.0.7, 1.0.8, 1.0.9, 2.0.0.post1, 2.0.1, 2.0.2, 2.0.3, 2.0.4, 2.0.5, 2.0.6, 2.0.6.post2, 2.0.7, 2.0.8, 2.0.9, 2.1.0, 2.1.1, 2.1.2.post3, 2.2.0, 2.2.1, 2.2.2, 2.2.3.post2, 2.2.4, 2.2.4.post1, 2.2.5, 2.3.0, 2.3.1.post1, 2.3.2, 2.3.3, 2.3.4, 2.3.5, 2.3.6, 2.4.0.post1, 2.4.1, 2.4.2, 2.4.3.post1, 2.5.0, 2.5.1.post1, 2.5.2, 2.5.3, 2.5.4, 2.5.5, 2.5.6, 2.5.7, 2.5.8, 2.5.9.post1, 2.6.0.post1, 2.6.1, 2.6.2, 2.6.3, 2.7.0.post2, 2.7.1.post4, 2.7.2.post1, 2.7.3, 2.7.4.post1)
ERROR: No matching distribution found for flash_attn==2.7.3

Could you please provide more detailed installation steps?

[michaelzhiluo]

Your cuda may be too old check? Recommended to have Cuda >=12.2

Also your disk may be out of space.

[hushyangqing]

Can you provide the environment.yml for conda?

[NotTheStallion]

The solution for this problem is to use "hydra-core 0.11.3".
In your terminal type pip install hydra-core==0.11.3.

The scratched solution i proposed doesn't work but it remove the warnings.
The code works by simply ignoring the package conflicts.