SSL Error when installing using private repository with https in pip==20.3

[twheys]

Environment

• pip version: 20.3
• Python version: 3.6.8
• OS: CentOS 7.7.1908 x86_64

Description

Running the command

pip3 install -U \
    --trusted-host pypi.python.org \
    --trusted-host {redacted} \
    -r requirements.txt

pip.conf

[global]
extra-index = https://{redacted}/repository/python/pypi
extra-index-url = https://{redacted}/repository/python/simple

Getting an SSL error raised trying to install from pypi and my private repository.

30-Nov-2020 12:54:54 | ERROR: Command errored out with exit status 1:
-- | --
30-Nov-2020 12:54:54 | command: venv/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/setup.py'"'"'; __file__='"'"'pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base pip-pip-egg-info-plmmsf24
30-Nov-2020 12:54:54 | cwd: pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/
30-Nov-2020 12:54:54 | Complete output (31 lines):
30-Nov-2020 12:54:54 | Downloading http://pypi.python.org/packages/source/d/distribute/distribute-0.6.14.tar.gz
30-Nov-2020 12:54:54 | Traceback (most recent call last):
30-Nov-2020 12:54:54 | File "pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/distribute_setup.py", line 143, in use_setuptools
30-Nov-2020 12:54:54 | raise ImportError
30-Nov-2020 12:54:54 | ImportError
30-Nov-2020 12:54:54 |  
30-Nov-2020 12:54:54 | During handling of the above exception, another exception occurred:
30-Nov-2020 12:54:54 |  
30-Nov-2020 12:54:54 | Traceback (most recent call last):
30-Nov-2020 12:54:54 | File "<string>", line 1, in <module>
30-Nov-2020 12:54:54 | File "pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/setup.py", line 4, in <module>
30-Nov-2020 12:54:54 | use_setuptools()
30-Nov-2020 12:54:54 | File "pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/distribute_setup.py", line 145, in use_setuptools
30-Nov-2020 12:54:54 | return _do_download(version, download_base, to_dir, download_delay)
30-Nov-2020 12:54:54 | File "pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/distribute_setup.py", line 124, in _do_download
30-Nov-2020 12:54:54 | to_dir, download_delay)
30-Nov-2020 12:54:54 | File "pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/distribute_setup.py", line 193, in download_setuptools
30-Nov-2020 12:54:54 | src = urlopen(url)
30-Nov-2020 12:54:54 | File "/usr/lib64/python3.6/urllib/request.py", line 223, in urlopen
30-Nov-2020 12:54:54 | return opener.open(url, data, timeout)
30-Nov-2020 12:54:54 | File "/usr/lib64/python3.6/urllib/request.py", line 532, in open
30-Nov-2020 12:54:54 | response = meth(req, response)
30-Nov-2020 12:54:54 | File "/usr/lib64/python3.6/urllib/request.py", line 642, in http_response
30-Nov-2020 12:54:54 | 'http', request, response, code, msg, hdrs)
30-Nov-2020 12:54:54 | File "/usr/lib64/python3.6/urllib/request.py", line 570, in error
30-Nov-2020 12:54:54 | return self._call_chain(*args)
30-Nov-2020 12:54:54 | File "/usr/lib64/python3.6/urllib/request.py", line 504, in _call_chain
30-Nov-2020 12:54:54 | result = func(*args)
30-Nov-2020 12:54:54 | File "/usr/lib64/python3.6/urllib/request.py", line 650, in http_error_default
30-Nov-2020 12:54:54 | raise HTTPError(req.full_url, code, msg, hdrs, fp)
30-Nov-2020 12:54:54 | urllib.error.HTTPError: HTTP Error 403: SSL is required
30-Nov-2020 12:54:54 | ----------------------------------------
30-Nov-2020 12:54:54 | ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

Rolling back to pip==20.2.4 fixes the issue for me.

Expected behavior

Setting --trusted-host option should resolve the issue with SSL.

How to Reproduce

Not really sure, but seems like installing from a private repository using HTTPS seems to be the cause.

Output

Paste the output of the steps above, including the commands themselves and
pip's output/traceback etc.

[uranusjr]

How did you install pip? If it is installed from the system package manager (i.e. yum), this should be reported to CentOS instead, since we can’t do anything about packages distributed by Linux distributions.

[dstufft]

This looks like an error that comes from the setup.py of.. maybe pytest? It looks like it's still using the old distribute_setup.py hack from like a decade ago.

[dstufft]

IOW, this error isn't coming from pip, it's coming from the package that's being installed, and pip can't do anything about it.

[twheys]

I'm installing (or rather upgrading) by running pip install -U pip. It does look like a package specific error but it happens only in pip 20.3, and not in previous versions. I noticed it in my CI starting today corresponding to the new pip version and rolling back to the previous version resolves it, so that leads me to believe pip is the problem here.

[pfmoore]

Is it a problem with the old version with --enable-feature=2020-resolver specified? Or conversely, does specifying --use-deprecated=legacy-resolver in the new version stop the issue from happening?

But regardless, @dstufft is correct, the error is being reported from code related to the (ancient) distribute library. There's no code like that in pip, so this doesn't look like a pip issue.

It may be that you have an incompatibility in your requirements (that the old resolver wasn't spotting). The new resolver is stricter and will not install incompatible packages, so it may be wroking back through older and older versions of your dependencies looking for something that works. When it gets back so far that it hits a version that won't even build nowadays (the distribute-related code) it fails.

So while we could likely produce a better error message, I suspect that the real issue is that your requirements can't be satisfied in a consistent way, and that's the root cause of your issue here.

[pradyunsg]

If you could provide the entire output from pip, that'd be ideal.

[twheys]

Full logs output

+ pip3 install -U pip
Cache entry deserialization failed, entry ignored
Collecting pip
  Downloading https://files.pythonhosted.org/packages/55/73/bce122d1ed0217b3c1a3439ab16dfa94bbeabd0d31755fcf907493abf39b/pip-20.3-py2.py3-none-any.whl (1.5MB)
Installing collected packages: pip
  Found existing installation: pip 9.0.3
    Uninstalling pip-9.0.3:
      Successfully uninstalled pip-9.0.3
Successfully installed pip-20.3
+ pip3 install -U setuptools
Looking in indexes: https://pypi.org/simple, https://{redacted}/repository/python/simple
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (39.2.0)
Collecting setuptools
  Downloading https://{redacted}/repository/python/packages/setuptools/50.3.2/setuptools-50.3.2-py3-none-any.whl (785 kB)
Installing collected packages: setuptools
  Attempting uninstall: setuptools
    Found existing installation: setuptools 39.2.0
    Uninstalling setuptools-39.2.0:
      Successfully uninstalled setuptools-39.2.0
Successfully installed setuptools-50.3.2
+ pip3 install -U --trusted-host pypi.python.org --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host {redacted} -r requirements.txt
Looking in indexes: https://pypi.org/simple, https://{redacted}/repository/python/simple
Collecting pytest
  Downloading https://{redacted}/repository/python/packages/pytest/6.1.2/pytest-6.1.2-py3-none-any.whl (272 kB)
Collecting requests==2.22.0
  Downloading https://{redacted}/repository/python/packages/requests/2.22.0/requests-2.22.0-py2.py3-none-any.whl (57 kB)
Collecting ruamel.yaml==0.15.89
  Downloading https://{redacted}/repository/python/packages/ruamel-yaml/0.15.89/ruamel.yaml-0.15.89-cp36-cp36m-manylinux1_x86_64.whl (651 kB)
Collecting whopper<1.1,>=1.0
  Using cached https://{redacted}/repository/python/packages/whopper/1.0.24/whopper-1.0.24-py3-none-any.whl (60 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.23/whopper-1.0.23-py3-none-any.whl (60 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.22/whopper-1.0.22-py3-none-any.whl (59 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.21/whopper-1.0.21-py3-none-any.whl (59 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.20/whopper-1.0.20-py3-none-any.whl (59 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.19/whopper-1.0.19-py3-none-any.whl (59 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.18/whopper-1.0.18-py3-none-any.whl (59 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.17/whopper-1.0.17-py3-none-any.whl (59 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.16/whopper-1.0.16-py3-none-any.whl (59 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.15/whopper-1.0.15-py3-none-any.whl (59 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.14/whopper-1.0.14-py3-none-any.whl (58 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.13/whopper-1.0.13-py3-none-any.whl (58 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.12/whopper-1.0.12-py3-none-any.whl (56 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.11/whopper-1.0.11-py3-none-any.whl (56 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.10/whopper-1.0.10-py3-none-any.whl (56 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.9/whopper-1.0.9-py3-none-any.whl (56 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.8/whopper-1.0.8-py3-none-any.whl (56 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.7/whopper-1.0.7-py3-none-any.whl (56 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.6/whopper-1.0.6-py3-none-any.whl (56 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.5/whopper-1.0.5-py3-none-any.whl (56 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.4/whopper-1.0.4-py3-none-any.whl (56 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.3/whopper-1.0.3-py3-none-any.whl (55 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.2/whopper-1.0.2-py3-none-any.whl (55 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.1/whopper-1.0.1-py3-none-any.whl (55 kB)
  Downloading https://{redacted}/repository/python/packages/whopper/1.0.0/whopper-1.0.0-py3-none-any.whl (56 kB)
INFO: pip is looking at multiple versions of ruamel-yaml to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of requests to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of pytest to determine which version is compatible with other requirements. This could take a while.
Collecting pytest
  Downloading https://{redacted}/repository/python/packages/pytest/6.1.1/pytest-6.1.1-py3-none-any.whl (272 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/6.1.0/pytest-6.1.0-py3-none-any.whl (272 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/6.0.2/pytest-6.0.2-py3-none-any.whl (270 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/6.0.1/pytest-6.0.1-py3-none-any.whl (270 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/6.0.0/pytest-6.0.0-py3-none-any.whl (270 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.4.3/pytest-5.4.3-py3-none-any.whl (248 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.4.2/pytest-5.4.2-py3-none-any.whl (247 kB)
INFO: pip is looking at multiple versions of ruamel-yaml to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of requests to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of pytest to determine which version is compatible with other requirements. This could take a while.
  Downloading https://{redacted}/repository/python/packages/pytest/5.4.1/pytest-5.4.1-py3-none-any.whl (246 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.4.0/pytest-5.4.0-py3-none-any.whl (247 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.3.5/pytest-5.3.5-py3-none-any.whl (235 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.3.4/pytest-5.3.4-py3-none-any.whl (235 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.3.3/pytest-5.3.3-py3-none-any.whl (235 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. If you want to abort this run, you can press Ctrl + C to do so. To improve how pip performs, tell us what happened here: https://pip.pypa.io/surveys/backtracking
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. If you want to abort this run, you can press Ctrl + C to do so. To improve how pip performs, tell us what happened here: https://pip.pypa.io/surveys/backtracking
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. If you want to abort this run, you can press Ctrl + C to do so. To improve how pip performs, tell us what happened here: https://pip.pypa.io/surveys/backtracking
  Downloading https://{redacted}/repository/python/packages/pytest/5.3.2/pytest-5.3.2-py3-none-any.whl (234 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.3.1/pytest-5.3.1-py3-none-any.whl (233 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.3.0/pytest-5.3.0-py3-none-any.whl (233 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.2.4/pytest-5.2.4-py3-none-any.whl (227 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.2.3/pytest-5.2.3-py3-none-any.whl (227 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.2.2/pytest-5.2.2-py3-none-any.whl (227 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.2.1/pytest-5.2.1-py3-none-any.whl (226 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.2.0/pytest-5.2.0-py3-none-any.whl (226 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.1.3/pytest-5.1.3-py3-none-any.whl (224 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.1.2/pytest-5.1.2-py3-none-any.whl (224 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.1.1/pytest-5.1.1-py3-none-any.whl (223 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.1.0/pytest-5.1.0-py3-none-any.whl (223 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.0.1/pytest-5.0.1-py3-none-any.whl (221 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/5.0.0/pytest-5.0.0-py3-none-any.whl (221 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.11/pytest-4.6.11-py2.py3-none-any.whl (231 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.10/pytest-4.6.10-py2.py3-none-any.whl (231 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.9/pytest-4.6.9-py2.py3-none-any.whl (231 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.8/pytest-4.6.8-py2.py3-none-any.whl (230 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.7/pytest-4.6.7-py2.py3-none-any.whl (230 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.6/pytest-4.6.6-py2.py3-none-any.whl (230 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.5/pytest-4.6.5-py2.py3-none-any.whl (230 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.4/pytest-4.6.4-py2.py3-none-any.whl (229 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.3/pytest-4.6.3-py2.py3-none-any.whl (229 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.2/pytest-4.6.2-py2.py3-none-any.whl (229 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.1/pytest-4.6.1-py2.py3-none-any.whl (229 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.6.0/pytest-4.6.0-py2.py3-none-any.whl (229 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/4.5.0/pytest-4.5.0-py2.py3-none-any.whl (227 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.4.2/pytest-4.4.2-py2.py3-none-any.whl (224 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.4.1/pytest-4.4.1-py2.py3-none-any.whl (223 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.4.0/pytest-4.4.0-py2.py3-none-any.whl (223 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.3.1/pytest-4.3.1-py2.py3-none-any.whl (219 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.3.0/pytest-4.3.0-py2.py3-none-any.whl (219 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.2.1/pytest-4.2.1-py2.py3-none-any.whl (218 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.2.0/pytest-4.2.0-py2.py3-none-any.whl (218 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.1.1/pytest-4.1.1-py2.py3-none-any.whl (216 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.1.0/pytest-4.1.0-py2.py3-none-any.whl (215 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.0.2/pytest-4.0.2-py2.py3-none-any.whl (217 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.0.1/pytest-4.0.1-py2.py3-none-any.whl (217 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/4.0.0/pytest-4.0.0-py2.py3-none-any.whl (217 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.10.1/pytest-3.10.1-py2.py3-none-any.whl (216 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.10.0/pytest-3.10.0-py2.py3-none-any.whl (216 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.9.3/pytest-3.9.3-py2.py3-none-any.whl (214 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.9.2/pytest-3.9.2-py2.py3-none-any.whl (214 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.9.1/pytest-3.9.1-py2.py3-none-any.whl (213 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.8.2/pytest-3.8.2-py2.py3-none-any.whl (209 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.8.1/pytest-3.8.1-py2.py3-none-any.whl (209 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.8.0/pytest-3.8.0-py2.py3-none-any.whl (208 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.7.4/pytest-3.7.4-py2.py3-none-any.whl (204 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.7.3/pytest-3.7.3-py2.py3-none-any.whl (204 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.7.2/pytest-3.7.2-py2.py3-none-any.whl (203 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.7.1/pytest-3.7.1-py2.py3-none-any.whl (202 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.7.0/pytest-3.7.0-py2.py3-none-any.whl (202 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.6.4/pytest-3.6.4-py2.py3-none-any.whl (196 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.6.3/pytest-3.6.3-py2.py3-none-any.whl (195 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.6.2/pytest-3.6.2-py2.py3-none-any.whl (195 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.6.1/pytest-3.6.1-py2.py3-none-any.whl (194 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.6.0/pytest-3.6.0-py2.py3-none-any.whl (194 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.5.1/pytest-3.5.1-py2.py3-none-any.whl (192 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.5.0/pytest-3.5.0-py2.py3-none-any.whl (194 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.4.2/pytest-3.4.2-py2.py3-none-any.whl (189 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.4.1/pytest-3.4.1-py2.py3-none-any.whl (188 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.4.0/pytest-3.4.0-py2.py3-none-any.whl (188 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.3.2/pytest-3.3.2-py2.py3-none-any.whl (185 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.3.1/pytest-3.3.1-py2.py3-none-any.whl (184 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.3.0/pytest-3.3.0-py2.py3-none-any.whl (184 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.2.5/pytest-3.2.5-py2.py3-none-any.whl (188 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.2.4/pytest-3.2.4-py2.py3-none-any.whl (188 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.2.3/pytest-3.2.3-py2.py3-none-any.whl (187 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.2.2/pytest-3.2.2-py2.py3-none-any.whl (187 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.2.1/pytest-3.2.1-py2.py3-none-any.whl (186 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.2.0/pytest-3.2.0-py2.py3-none-any.whl (186 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.1.3/pytest-3.1.3-py2.py3-none-any.whl (181 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.1.2/pytest-3.1.2-py2.py3-none-any.whl (180 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.1.1/pytest-3.1.1-py2.py3-none-any.whl (179 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.1.0/pytest-3.1.0-py2.py3-none-any.whl (178 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.0.7/pytest-3.0.7-py2.py3-none-any.whl (172 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.0.6/pytest-3.0.6-py2.py3-none-any.whl (172 kB)
Requirement already satisfied: setuptools in ./venv/lib/python3.6/site-packages (from pytest->-r requirements.txt (line 4)) (50.3.2)
  Downloading https://{redacted}/repository/python/packages/pytest/3.0.5/pytest-3.0.5-py2.py3-none-any.whl (170 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/3.0.4/pytest-3.0.4-py2.py3-none-any.whl (170 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/3.0.3/pytest-3.0.3-py2.py3-none-any.whl (169 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/3.0.2/pytest-3.0.2-py2.py3-none-any.whl (169 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/3.0.1/pytest-3.0.1-py2.py3-none-any.whl (169 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/3.0.0/pytest-3.0.0-py2.py3-none-any.whl (168 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.9.2/pytest-2.9.2-py2.py3-none-any.whl (162 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.9.1/pytest-2.9.1-py2.py3-none-any.whl (161 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.9.0/pytest-2.9.0-py2.py3-none-any.whl (161 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.8.7/pytest-2.8.7-py2.py3-none-any.whl (151 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.8.6/pytest-2.8.6-py2.py3-none-any.whl (151 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.8.5/pytest-2.8.5-py2.py3-none-any.whl (151 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.8.4/pytest-2.8.4-py2.py3-none-any.whl (150 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.8.3/pytest-2.8.3-py2.py3-none-any.whl (149 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.8.2/pytest-2.8.2-py2.py3-none-any.whl (149 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.8.1/pytest-2.8.1-py2.py3-none-any.whl (148 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.8.0/pytest-2.8.0-py2.py3-none-any.whl (147 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.7.3/pytest-2.7.3-py2.py3-none-any.whl (128 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.7.2/pytest-2.7.2-py2.py3-none-any.whl (127 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.7.1/pytest-2.7.1-py2.py3-none-any.whl (126 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.7.0/pytest-2.7.0.tar.gz (526 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.6.4/pytest-2.6.4.tar.gz (512 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.6.3/pytest-2.6.3.tar.gz (634 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.6.2/pytest-2.6.2.tar.gz (629 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.6.1/pytest-2.6.1.tar.gz (627 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.6.0/pytest-2.6.0.tar.gz (625 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.5.2/pytest-2.5.2.tar.gz (608 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.5.1/pytest-2.5.1.tar.gz (577 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.5.0/pytest-2.5.0.tar.gz (572 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.4.2/pytest-2.4.2.tar.gz (553 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.4.1/pytest-2.4.1.tar.gz (551 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.4.0/pytest-2.4.0.tar.gz (547 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.3.5/pytest-2.3.5.tar.gz (426 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.3.4/pytest-2.3.4.zip (527 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.3.3/pytest-2.3.3.zip (521 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.3.2/pytest-2.3.2.zip (515 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.3.1/pytest-2.3.1.zip (512 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.3.0/pytest-2.3.0.zip (513 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.2.4/pytest-2.2.4.zip (309 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.2.3/pytest-2.2.3.zip (307 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.2.2/pytest-2.2.2.zip (307 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.2.1/pytest-2.2.1.zip (304 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.2.0/pytest-2.2.0.zip (302 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.1.3/pytest-2.1.3.zip (291 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.1.2/pytest-2.1.2.zip (290 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.1.1/pytest-2.1.1.zip (288 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.1.0/pytest-2.1.0.zip (284 kB)
  Downloading https://{redacted}/repository/python/packages/pytest/2.0.3/pytest-2.0.3.zip (259 kB)
    ERROR: Command errored out with exit status 1:
     command: ~/xml-data/build-dir/WOPR-WOPR-WOPR/venv/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'./pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/setup.py'"'"'; __file__='"'"'./pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base ./pip-pip-egg-info-plmmsf24
         cwd: ./pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/
    Complete output (31 lines):
    Downloading http://pypi.python.org/packages/source/d/distribute/distribute-0.6.14.tar.gz
    Traceback (most recent call last):
      File "./pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/distribute_setup.py", line 143, in use_setuptools
        raise ImportError
    ImportError
    
    During handling of the above exception, another exception occurred:
    
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "./pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/setup.py", line 4, in <module>
        use_setuptools()
      File "./pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/distribute_setup.py", line 145, in use_setuptools
        return _do_download(version, download_base, to_dir, download_delay)
      File "./pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/distribute_setup.py", line 124, in _do_download
        to_dir, download_delay)
      File "./pip-install-_vatl_q7/pytest_63d4a274a4e64ac4a2c6beaff19454cd/distribute_setup.py", line 193, in download_setuptools
        src = urlopen(url)
      File "/usr/lib64/python3.6/urllib/request.py", line 223, in urlopen
        return opener.open(url, data, timeout)
      File "/usr/lib64/python3.6/urllib/request.py", line 532, in open
        response = meth(req, response)
      File "/usr/lib64/python3.6/urllib/request.py", line 642, in http_response
        'http', request, response, code, msg, hdrs)
      File "/usr/lib64/python3.6/urllib/request.py", line 570, in error
        return self._call_chain(*args)
      File "/usr/lib64/python3.6/urllib/request.py", line 504, in _call_chain
        result = func(*args)
      File "/usr/lib64/python3.6/urllib/request.py", line 650, in http_error_default
        raise HTTPError(req.full_url, code, msg, hdrs, fp)
    urllib.error.HTTPError: HTTP Error 403: SSL is required
    ----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

[pfmoore]

I'm pretty certain from this that the problem is that pip is backtracking to a point where it's hitting versions so old that they can't be built (because of that distribute hack).

We've had a number of discussions about how we "give up" when backtracking is going too far, but we don't (yet) have a good answer on how to decide what constitutes "too far" (there are packages on PyPI that release multiple releases per day, every day, so simple answers like "no more than this many versions" could be problematic).

[dmcnulla]

I got the same thing. I worked around it by specifying to upgrad pip to 20.2 in my Dockerfile.

[pradyunsg]

This is now fixed with #9264.