Skip to content

CI: Align Azure & GHA dependencies #45478

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 113 commits into from
Closed

CI: Align Azure & GHA dependencies #45478

wants to merge 113 commits into from

Conversation

@mroeschke
Copy link
Member

@mroeschke mroeschke commented Jan 19, 2022 •
edited
Loading

Progress toward #29685

  • Share same dependency files between Azure and GHA
  • Bump Windows and macOS images to latest
  • Don't split Azure jobs by increasing timeout beyond 1 hour

Discoveries:

  • Windows and psutil in a multiprocess environment don't play nice
  • Anything that spawns threads like numba / pyarrow can cause issues on Azure (more so on Windows than MacOS)

@mroeschke mroeschke marked this pull request as draft January 19, 2022 21:57
@mroeschke mroeschke mentioned this pull request Jan 20, 2022
Closed
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
9e177a3
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
7b76855
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
a620d2a
@mroeschke
Cap at 120 mins
0d3bfb1
@mroeschke
Verbose
ff6e2da
@mroeschke
Align pattern and timeoutinMinutes
c49e684
@mroeschke
Skip db as well
20dcc49
@mroeschke
Mark more db tests
e6db0ed
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
e733795
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
fe90b32
@mroeschke
Skip moments tests on windows
aa2e03a
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
63fc793
@mroeschke
Add PANDAS_CI in azure-pipelines.yml
0bb104f
@mroeschke
Remove unused fixture which causes hang?
e275343
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
35f2498
@mroeschke
Try this condiditon
53340a5
@mroeschke
Actually is it numba on windows?
97e04cd
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
91bba48
@mroeschke
Don't even collect moments tests
0b95106
@mroeschke
Exclude numba tests
02cb9c2
@mroeschke
Maybe use a context manager?
63015f6
@mroeschke
Maybe longer timeout for windows?
16cf72d
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
7749682
@mroeschke mroeschke mentioned this pull request Feb 2, 2022
Merged
@mroeschke mroeschke mentioned this pull request Feb 2, 2022
Merged
2 tasks
@mroeschke
Revert "Try passing use_threads in pyarrow again"
985542b 
This reverts commit c696740.
@mroeschke
Revert "Change number of workers"
84ed1fb 
This reverts commit 11ad11d.
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
cdfd056
@mroeschke
Try reinstalling pyarrow again
d41fa26
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
5096d5e
@mroeschke
Try upgrading pyarrow instead
777c977
@mroeschke
Remove fastparquet from macos
9cbc5d3
@mroeschke
specify conda forge?
b994e24
@mroeschke
Try upgrading pyarrow again
41b17a0
@mroeschke
Remove fastparquet
13742d7
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
0d6c676
@mroeschke
Force uninstall
8852ae4
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
9364966
@mroeschke
Use an xfail
3e7e3bc
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
d737eaa
@mroeschke
Address some mac test
311dd9c
@mroeschke
Merge remote-tracking branch 'upstream/main' into ci/align_azure
424b77d
@mroeschke
Fix more tests
ae8f616
@mroeschke mroeschke mentioned this pull request Feb 7, 2022
Merged
2 tasks
@mroeschke mroeschke removed this from the 1.4.1 milestone Feb 7, 2022
@mroeschke mroeschke closed this Feb 7, 2022
@mroeschke mroeschke deleted the ci/align_azure branch February 7, 2022 21:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jreback jreback Awaiting requested review from jreback

Assignees

No one assigned

Labels

CI Continuous Integration

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@mroeschke @jreback