-
Notifications
You must be signed in to change notification settings - Fork 107
Change dependency update function to operate on index.html only rather then copy whls over #7487
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…r then copy whls over
|
@atalman is attempting to deploy a commit to the Meta Open Source Team on Vercel. A member of the Team first needs to authorize it. |
|
|
||
| def is_nvidia_package(pkg_name: str) -> bool: | ||
| """Check if a package is from NVIDIA and should use pypi.nvidia.com""" | ||
| return pkg_name.startswith("nvidia-") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We might need to add more logic to this as not all packages start with nvidia-, e.g. https://pypi.org/project/cuda-bindings/ or https://pypi.org/project/cuda-cccl/ in case these will be added in the future. Not blocking for now, just leaving this as a comment for my future self.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good! Thanks very much. Just wondering how could we test this change. Seems like we will do it incrementally, so +1ed.
|
HI @tinglvv testing via validation framework. I am currently testing this change |
Fixes : pytorch/pytorch#159409
We process index.html file rather then whl files. This will allow us to remove all conda and pypi dependencies from our s3 and CDN.
CUDA package example: https://pypi.nvidia.com/nvidia-cuda-nvrtc/
Simple pypi index example: https://pypi.org/simple/filelock/
Deployment strategy: