Skip to content

Add User Agent to avoid HTTP 403 #10

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

Add User Agent to avoid HTTP 403 #10

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f6ef64a
feat(autoload): add user-agent to urllib requests to avoid http 403
gierens Nov 28, 2023
c8c61a2
style(autoload): remove trailing space
gierens Nov 28, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 13 additions & 3 deletions autoload/rfc.vim
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ if !has('win32')
endif

function! rfc#query(create_cache_file, query) abort
if !s:has_python3
if !s:has_python3
echomsg 'vim-rfc: This plugin requires +python3 support for :python3 and py3eval().'
if has('nvim')
echomsg 'Run ":checkhealth provider" for further diagnosis.'
Expand Down Expand Up @@ -93,10 +93,20 @@ function! s:open_entry_by_cr()
endfunction

python3 << EOF
def _build_req(url):
from urllib.request import Request
return Request(
url,
data=None,
headers={
'User-Agent': 'Mozilla/5.0 (compatible; vim-rfc)',
}
)

def fetch_rfc(url):
import urllib.request
try:
rfc = urllib.request.urlopen(url).read().decode('utf-8').splitlines()
rfc = urllib.request.urlopen(_build_req(url)).read().decode('utf-8').splitlines()
except urllib.request.URLError as e:
print(f'{e}\nFetching RFC failed. Connected to the internet? Behind proxy?')
return False
Expand All @@ -111,7 +121,7 @@ def create_cache_file():
import xml.etree.ElementTree as ET

try:
xml = urllib.request.urlopen('https://www.rfc-editor.org/in-notes/rfc-index.xml').read()
xml = urllib.request.urlopen(_build_req('https://www.rfc-editor.org/rfc-index.xml')).read()
except urllib.error.URLError as e:
print(f'{e}\nFetching RFC index failed. Connected to the internet? Behind proxy?')
return False
Expand Down