Skip to content

Conversation

@mthrok
Copy link
Contributor

@mthrok mthrok commented Nov 3, 2021

This PR changes the build process so that the third party code are fetched automatically when setup.py is invoked.

This is to allow

  1. build_sdist to contain the third party library codes, so that source code distribution created at the time release tag is created is complete.
  2. It makes it possible to do pip install https://github.com/pytorch/audio.git.
    Example: https://colab.research.google.com/drive/1hK-WfiIKDTgccOmbdPwMd-b9LTA8Yg0n?usp=sharing
    !pip install 'cmake>=3.18' ninja
    !pip install --verbose git+https://github.com/mthrok/audio.git@auto-source
    

Note:
I am changing all the CI test job to use pip install ... in place of python setup.py ..., following the movement around PEP 517 (interesting read https://bernat.tech/posts/pep-517-518/), but I leave the packaging script as-is.

See also pytorch/text#1154

@mthrok mthrok marked this pull request as ready for review November 3, 2021 15:48
@mthrok mthrok requested a review from malfet November 3, 2021 15:48
@mthrok mthrok merged commit af336d6 into pytorch:main Nov 3, 2021
@mthrok mthrok deleted the auto-source branch November 3, 2021 17:39
@github-actions
Copy link

github-actions bot commented Nov 3, 2021

Hey @mthrok!
You merged this PR, but labels were not properly added. Please add a primary and secondary label
(See https://github.com/pytorch/audio/blob/main/.github/process_commit.py)

mthrok added a commit that referenced this pull request Nov 3, 2021
After #1966, `git submodule` is performed automatically.
@mthrok mthrok mentioned this pull request Nov 3, 2021
mthrok added a commit that referenced this pull request Nov 4, 2021
After #1966, `git submodule` is performed automatically.
mthrok added a commit to mthrok/audio that referenced this pull request Nov 30, 2021
This commit changes the build process so that the third party code are fetched automatically when `setup.py` is invoked.

This is to allow
1. `build_sdist` to contain the third party library codes, so that source code distribution created at the time release tag is created is complete.
2. It makes it possible to do `pip install https://github.com/pytorch/audio.git`.
    Example:
    ```
    !pip install 'cmake>=3.18' ninja
    !pip install --verbose git+https://github.com/pytorch/audio.git@auto-source
    ```
mthrok added a commit to mthrok/audio that referenced this pull request Dec 3, 2021
This commit changes the build process so that the third party code are fetched automatically when `setup.py` is invoked.

This is to allow
1. `build_sdist` to contain the third party library codes, so that source code distribution created at the time release tag is created is complete.
2. It makes it possible to do `pip install https://github.com/pytorch/audio.git`.
    Example:
    ```
    !pip install 'cmake>=3.18' ninja
    !pip install --verbose git+https://github.com/pytorch/audio.git@auto-source
    ```
mthrok added a commit that referenced this pull request Dec 3, 2021
This commit changes the build process so that the third party code are fetched automatically when `setup.py` is invoked.

This is to allow
1. `build_sdist` to contain the third party library codes, so that source code distribution created at the time release tag is created is complete.
2. It makes it possible to do `pip install https://github.com/pytorch/audio.git`.
    Example:
    ```
    !pip install 'cmake>=3.18' ninja
    !pip install --verbose git+https://github.com/pytorch/audio.git@auto-source
    ```
mthrok added a commit to mthrok/text that referenced this pull request Jun 23, 2022
This commit adds `git` submodule initialization commands at the beginning
of setup, so that third party modules become available automatically.

This makes it possible to install torchtext with a command like
`pip install --no-use-pep517 git+https://github.com/pytorch/text.git`

See also:
- pytorch#1154
- pytorch/audio#1966
mthrok added a commit to pytorch/text that referenced this pull request Jun 23, 2022
* Automatically initialize submodule

This commit adds `git` submodule initialization commands at the beginning
of setup, so that third party modules become available automatically.

This makes it possible to install torchtext with a command like
`pip install --no-use-pep517 git+https://github.com/pytorch/text.git`

See also:
- #1154
- pytorch/audio#1966
mthrok pushed a commit to mthrok/audio that referenced this pull request Dec 13, 2022
As system has been migrated to Focal few month back
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants