Skip to content

[dockers] install nvidia-dali-cudaXXX #4532

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
Nov 9, 2020
Merged

[dockers] install nvidia-dali-cudaXXX #4532

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
f10acba
[dockers] install nvidia-dali-cuda100
Nov 5, 2020
ce23eb8
Apply suggestions from code review
Borda Nov 5, 2020
684c4c6
build DALI
Borda Nov 5, 2020
4b89bf7
build DALI
Borda Nov 5, 2020
05c31a1
build DALI
Borda Nov 6, 2020
a92b069
dali from source
Nov 6, 2020
57c5f10
dali from source
Nov 6, 2020
c160d9d
use binaries
Borda Nov 6, 2020
aaaa55f
qq
Borda Nov 6, 2020
6f1bd28
Merge branch 'master' into dockers/dali
Nov 8, 2020
938425d
Merge branch 'master' into dockers/dali
Nov 9, 2020
cc1c5db
Merge branch 'master' into dockers/dali
Nov 9, 2020
1245f82
Merge branch 'master' into dockers/dali
SeanNaren Nov 9, 2020
5227529
Merge branch 'master' into dockers/dali
SeanNaren Nov 9, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions dockers/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,10 +14,10 @@ or with specific arguments
```bash
git clone <git-repository>
docker image build \
-t pytorch-lightning:py3.8 \
-f dockers/conda/Dockerfile \
-t pytorch-lightning:py3.8-pt1.6 \
-f dockers/base-cuda/Dockerfile \
--build-arg PYTHON_VERSION=3.8 \
--build-arg PYTORCH_VERSION=1.4 \
--build-arg PYTORCH_VERSION=1.6 \
.
```

Expand Down
6 changes: 4 additions & 2 deletions dockers/base-conda/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,8 @@ SHELL ["/bin/bash", "-c"]

ENV PATH="$PATH:/root/.local/bin"

RUN apt-get update && apt-get install -y --no-install-recommends \
RUN apt-get update -qq && \
apt-get install -y --no-install-recommends \
build-essential \
cmake \
git \
Expand Down Expand Up @@ -104,6 +105,7 @@ RUN \
# Install remaining requirements
pip install -r requirements-extra.txt --upgrade-strategy only-if-needed && \
pip install -r requirements-test.txt --upgrade-strategy only-if-needed && \
pip install --extra-index-url https://developer.download.nvidia.com/compute/redist nvidia-dali-cuda${CUDA_VERSION%%.*}0 && \
rm requirements*

RUN \
Expand All @@ -118,4 +120,4 @@ RUN \
conda info && \
pip list && \
python -c "import sys; assert sys.version[:3] == '$PYTHON_VERSION', sys.version" && \
python -c "import torch; assert torch.__version__[:3] == '$PYTORCH_VERSION', torch.__version__"
python -c "import torch; assert torch.__version__[:3] == '$PYTORCH_VERSION', torch.__version__"
7 changes: 5 additions & 2 deletions dockers/base-cuda/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ FROM nvidia/cuda:${CUDA_VERSION}-cudnn${CUDNN_VERSION}-devel-ubuntu18.04

ARG PYTHON_VERSION=3.7
ARG PYTORCH_VERSION=1.6
ARG CMAKE_VERSION=3.18.4

SHELL ["/bin/bash", "-c"]
# https://techoverflow.net/2019/05/18/how-to-fix-configuring-tzdata-interactive-input-when-building-docker-images/
Expand All @@ -37,7 +38,7 @@ ENV TZ=Europe/Prague
ENV PATH="$PATH:/root/.local/bin"
ENV CUDA_TOOLKIT_ROOT_DIR="/usr/local/cuda"

RUN apt-get update && \
RUN apt-get update -qq && \
apt-get install -y --no-install-recommends \
build-essential \
pkg-config \
Expand Down Expand Up @@ -93,6 +94,7 @@ RUN \

# Install all requirements
pip install -r requirements/devel.txt --upgrade-strategy only-if-needed --use-feature=2020-resolver && \
pip install --extra-index-url https://developer.download.nvidia.com/compute/redist nvidia-dali-cuda${CUDA_VERSION%%.*}0 && \
rm -rf requirements*

RUN \
Expand All @@ -105,5 +107,6 @@ RUN \
# Show what we have
pip --version && \
pip list && \
python -c 'from nvidia.dali.pipeline import Pipeline' && \
python -c "import sys; assert sys.version[:3] == '$PYTHON_VERSION', sys.version" && \
python -c "import torch; assert torch.__version__[:3] == '$PYTORCH_VERSION', torch.__version__"
python -c "import torch; assert torch.__version__[:3] == '$PYTORCH_VERSION', torch.__version__"
2 changes: 1 addition & 1 deletion dockers/base-xla/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ ENV CONDA_ENV=lightning
# show system inforation
RUN lsb_release -a && cat /etc/*-release

RUN apt-get update && \
RUN apt-get update -qq && \
apt-get install -y --no-install-recommends \
build-essential \
cmake \
Expand Down