Link checker is failing on NOAA homepage #31
Description
Recently the nightly link check started failing with
403 Client Error: Forbidden for url: https://www.noaa.gov/
This looks to me like the same issue we encountered in Foundations with certain websites rejecting the sphinx link-checker, see here:
ProjectPythia/pythia-foundations#260
sphinx-doc/sphinx#10343
ProjectPythia/pythia-foundations#262
Two possible workarounds:
- skip the link check for this site only, by adding "https://www.noaa.gov" to the
linkcheck_ignore:line in the config file - Run a valid link check for this site by "spoofing" a user agent with
linkcheck_request_headers:as we did in Foundations Replace linkcheck ignore with custom user agent pythia-foundations#262