Skip to content

Compile bug: .devops/cuda.Dockerfile fails if BASE_CUDA_DEV_CONTAINER is based on Ubuntu 24.04 #15004

@simevo

Description

@simevo

Git commit

release b6040

Operating systems

Linux

GGML backends

CUDA

Problem description & steps to reproduce

I tried building the CUDA docker container with BASE_CUDA_DEV_CONTAINER=nvcr.io/nvidia/nvhpc:25.3-devel-cuda12.8-ubuntu24.04 and it failed because on Ubuntu 24.04 pip install requires the --break-system-packages option.

I have a fix and will provide a PR shortly.

First Bad Commit

Compile command

docker build --build-arg BASE_CUDA_DEV_CONTAINER=nvcr.io/nvidia/nvhpc:25.3-devel-cuda12.8-ubuntu24.04 --build-arg BASE_CUDA_RUN_CONTAINER=nvcr.io/nvidia/nvhpc:25.3-runtime-cuda12.8-ubuntu24.04 --build-arg CUDA_DOCKER_ARCH=80 -f .devops/cuda.Dockerfile .

Relevant log output

error: externally-managed-environment

× This environment is externally managed
╰─> To install Python packages system-wide, try apt install
    python3-xyz, where xyz is the package you are trying to
    install.
    
    If you wish to install a non-Debian-packaged Python package,
    create a virtual environment using python3 -m venv path/to/venv.
    Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
    sure you have python3-full installed.
    
    If you wish to install a non-Debian packaged Python application,
    it may be easiest to use pipx install xyz, which will manage a
    virtual environment for you. Make sure you have pipx installed.
    
    See /usr/share/doc/python3.12/README.venv for more information.

note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages.
hint: See PEP 668 for the detailed specification.
The command '/bin/sh -c apt-get update     && apt-get install -y     git     python3     python3-pip     && pip install --upgrade pip setuptools wheel     && pip install -r requirements.txt     && apt autoremove -y     && apt clean -y     && rm -rf /tmp/* /var/tmp/*     && find /var/cache/apt/archives /var/lib/apt/lists -not -name lock -type f -delete     && find /var/cache -type f -delete' returned a non-zero code: 1

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions