-
Notifications
You must be signed in to change notification settings - Fork 12.8k
Closed
Labels
Description
Git commit
release b6040
Operating systems
Linux
GGML backends
CUDA
Problem description & steps to reproduce
I tried building the CUDA docker container with BASE_CUDA_DEV_CONTAINER=nvcr.io/nvidia/nvhpc:25.3-devel-cuda12.8-ubuntu24.04
and it failed because on Ubuntu 24.04 pip install requires the --break-system-packages
option.
I have a fix and will provide a PR shortly.
First Bad Commit
Compile command
docker build --build-arg BASE_CUDA_DEV_CONTAINER=nvcr.io/nvidia/nvhpc:25.3-devel-cuda12.8-ubuntu24.04 --build-arg BASE_CUDA_RUN_CONTAINER=nvcr.io/nvidia/nvhpc:25.3-runtime-cuda12.8-ubuntu24.04 --build-arg CUDA_DOCKER_ARCH=80 -f .devops/cuda.Dockerfile .
Relevant log output
error: externally-managed-environment
× This environment is externally managed
╰─> To install Python packages system-wide, try apt install
python3-xyz, where xyz is the package you are trying to
install.
If you wish to install a non-Debian-packaged Python package,
create a virtual environment using python3 -m venv path/to/venv.
Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
sure you have python3-full installed.
If you wish to install a non-Debian packaged Python application,
it may be easiest to use pipx install xyz, which will manage a
virtual environment for you. Make sure you have pipx installed.
See /usr/share/doc/python3.12/README.venv for more information.
note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages.
hint: See PEP 668 for the detailed specification.
The command '/bin/sh -c apt-get update && apt-get install -y git python3 python3-pip && pip install --upgrade pip setuptools wheel && pip install -r requirements.txt && apt autoremove -y && apt clean -y && rm -rf /tmp/* /var/tmp/* && find /var/cache/apt/archives /var/lib/apt/lists -not -name lock -type f -delete && find /var/cache -type f -delete' returned a non-zero code: 1