Skip to content

Commit c9d1ece

Browse files
committed
[MINOR][INFRA] List pip installation before test in python macos test and python connect test
### What changes were proposed in this pull request? List pip installation before test in python macos test and python connect test ### Why are the changes needed? to improve the debugability, no need to check the installation log ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? ci ### Was this patch authored or co-authored using generative AI tooling? no Closes #49901 from zhengruifeng/infra_list_pip. Authored-by: Ruifeng Zheng <[email protected]> Signed-off-by: Ruifeng Zheng <[email protected]> (cherry picked from commit d6fe024) Signed-off-by: Ruifeng Zheng <[email protected]>
1 parent c2d368b commit c9d1ece

File tree

3 files changed

+8
-3
lines changed

3 files changed

+8
-3
lines changed

.github/workflows/build_python_connect.yml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -72,7 +72,9 @@ jobs:
7272
python packaging/connect/setup.py sdist
7373
cd dist
7474
pip install pyspark*connect-*.tar.gz
75-
pip install 'six==1.16.0' 'pandas==2.2.3' scipy 'plotly<6.0.0' 'mlflow>=2.8.1' coverage matplotlib openpyxl 'memory-profiler>=0.61.0' 'scikit-learn>=1.3.2' 'graphviz==0.20.3' 'torch<2.6.0' torchvision torcheval deepspeed unittest-xml-reporting 'plotly>=4.8'
75+
pip install 'six==1.16.0' 'pandas==2.2.3' scipy 'plotly<6.0.0' 'mlflow>=2.8.1' coverage matplotlib openpyxl 'memory-profiler>=0.61.0' 'scikit-learn>=1.3.2' 'graphviz==0.20.3' 'torch<2.6.0' torchvision torcheval deepspeed unittest-xml-reporting
76+
- name: List Python packages
77+
run: python -m pip list
7678
- name: Run tests (local)
7779
env:
7880
SPARK_TESTING: 1

.github/workflows/build_python_connect35.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -75,6 +75,8 @@ jobs:
7575
7676
# Add torch as a testing dependency for TorchDistributor
7777
pip install 'torch==2.0.1' 'torchvision==0.15.2' torcheval
78+
- name: List Python packages
79+
run: python -m pip list
7880
- name: Run tests
7981
env:
8082
SPARK_TESTING: 1

.github/workflows/python_macos_test.yml

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -135,8 +135,9 @@ jobs:
135135
python${{matrix.python}} -m pip install --ignore-installed 'six==1.16.0'
136136
python${{matrix.python}} -m pip install numpy 'pyarrow>=15.0.0' 'six==1.16.0' 'pandas==2.2.3' scipy 'plotly<6.0.0' 'mlflow>=2.8.1' coverage matplotlib openpyxl 'memory-profiler>=0.61.0' 'scikit-learn>=1.3.2' unittest-xml-reporting && \
137137
python${{matrix.python}} -m pip install 'grpcio==1.67.0' 'grpcio-status==1.67.0' 'protobuf==5.29.1' 'googleapis-common-protos==1.65.0' 'graphviz==0.20.3' && \
138-
python${{matrix.python}} -m pip cache purge && \
139-
python${{matrix.python}} -m pip list
138+
python${{matrix.python}} -m pip cache purge
139+
- name: List Python packages
140+
run: python${{matrix.python}} -m pip list
140141
# Run the tests.
141142
- name: Run tests
142143
env: ${{ fromJSON(inputs.envs) }}

0 commit comments

Comments
 (0)