Skip to content

Commit e16d4fb

Browse files
authored
CI code cleaning (#7615)
1 parent f6d892a commit e16d4fb

File tree

5 files changed

+3
-89
lines changed

5 files changed

+3
-89
lines changed

.azure-pipelines/gpu-tests.yml

Lines changed: 2 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -55,13 +55,9 @@ jobs:
5555
displayName: 'Image info & NVIDIA'
5656
5757
- bash: |
58-
export GIT_TERMINAL_PROMPT=1
59-
#sudo apt-get install -y cmake
60-
# python -m pip install "pip==20.1"
61-
pip install --requirement requirements.txt
6258
python -c "fname = 'requirements/extra.txt' ; lines = [line for line in open(fname).readlines() if 'horovod' not in line] ; open(fname, 'w').writelines(lines)"
63-
pip install --requirement ./requirements/devel.txt --upgrade-strategy only-if-needed
64-
pip install fairscale>=0.3.4 --upgrade-strategy only-if-needed
59+
pip install fairscale>=0.3.4
60+
pip install . --requirement requirements/devel.txt
6561
pip list
6662
displayName: 'Install dependencies'
6763
@@ -114,15 +110,9 @@ jobs:
114110
115111
- script: |
116112
set -e
117-
python setup.py install --user
118-
rm -rf pytorch_lightning
119-
pip list
120113
python -m pytest pl_examples -v --maxfail=2 --durations=0
121114
bash pl_examples/run_examples-args.sh --trainer.gpus 1 --trainer.max_epochs 1 --data.batch_size 64 --trainer.limit_train_batches 5 --trainer.limit_val_batches 3
122115
bash pl_examples/run_ddp-examples.sh --trainer.max_epochs 1 --data.batch_size 32 --trainer.limit_train_batches 2 --trainer.limit_val_batches 2
123-
# cd pl_examples/basic_examples
124-
# bash submit_ddp_job.sh
125-
# bash submit_ddp2_job.sh
126116
env:
127117
PL_USE_MOCKED_MNIST: "1"
128118
displayName: 'Examples'

.github/workflows/ci_pkg-install.yml

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,8 +15,7 @@ jobs:
1515
fail-fast: false
1616
# max-parallel: 6
1717
matrix:
18-
# PyTorch 1.5 is failing on Win and bolts requires torchvision>=0.5
19-
os: [ubuntu-20.04, macOS-10.15 , windows-2019] #
18+
os: [ubuntu-20.04, macOS-10.15, windows-2019]
2019
python-version: [3.6, 3.9]
2120

2221
steps:

pl_examples/basic_examples/README.md

Lines changed: 0 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -58,16 +58,3 @@ To run this demo do the following:
5858
1. Log into the jumphost node of your SLURM-managed cluster.
5959
2. Create a conda environment with Lightning and a GPU PyTorch version.
6060
3. Choose a script to submit
61-
62-
#### DDP
63-
Submit this job to run with DistributedDataParallel (2 nodes, 2 gpus each)
64-
```bash
65-
sbatch submit_ddp_job.sh YourEnv
66-
```
67-
68-
#### DDP2
69-
Submit this job to run with a different implementation of DistributedDataParallel.
70-
In this version, each node acts like DataParallel but syncs across nodes like DDP.
71-
```bash
72-
sbatch submit_ddp2_job.sh YourEnv
73-
```

pl_examples/basic_examples/submit_ddp2_job.sh

Lines changed: 0 additions & 31 deletions
This file was deleted.

pl_examples/basic_examples/submit_ddp_job.sh

Lines changed: 0 additions & 31 deletions
This file was deleted.

0 commit comments

Comments
 (0)