Adding non-cached links to sources.list

[bmharsha]

WinRPM is encountering download errors because cached links are failing on some Windows servers, removing the caching resolves this issue on those servers. So, this PR provides non-cached links as alternative whenever cached links fail.

[tkelman]

What does a log look like when both links work?

[bmharsha]

What does a log look like when both links work?

Here is a log when both links work
https://gist.github.com/bmharsha/c79def27220871a7e85243103daf83ae#file-winrpm_both_working-md

[tkelman]

and packages install correctly?

[bmharsha]

and packages install correctly?

Yes, WinRPM installs correctly and I tried a few examples from WinRPM readme, here is a log of that.

https://gist.github.com/bmharsha/c79def27220871a7e85243103daf83ae#file-winrpm_usage-md

[tkelman]

All those multiple candidate warnings are a problem, so this isn't great as is. Will need to find a way to avoid all those.

[tkelman]

One thing we could try is leave sources.list alone, but if the download gets to its retry limit then try again with the cache prefix removed as part of the download code.

[musm]

I am pretty sure the download function is fundamentally bugged.

@bmharsha Is your system 32-bit ?

[musm]

On my fork I think I have at least fixed the download issue I get with HDF5 for 32-bit windows (at least on 0.5 and 0.6). You can try my fork and see if it fixes things for you https://github.com/musm/WinRPM.jl

On 0.7 I get a strange stack overflow error with a circular reference https://ci.appveyor.com/project/musm/winrpm-jl/build/job/nuoo2f5do90wm8dh

[bmharsha]

@bmharsha Is your system 32-bit ?

No, it's a 64 bit system.

On my fork I think I have at least fixed the download issue I get with HDF5 for 32-bit windows (at least on 0.5 and 0.6). You can try my fork and see if it fixes things for you https://github.com/musm/WinRPM.jl

Sure, I'll try this and report back, thanks.

[musm]

Thanks. Another option is just to get rid of the download function and use the one in Base.

[bmharsha]

@musm I tried your fork on "Windows Server 2012 R2 datacenter" (64 bit), I'm still seeing download errors, here is a full log

https://gist.github.com/bmharsha/c79def27220871a7e85243103daf83ae#file-musm_winrpm-md

[musm]

@bmharsha Sorry about that. Do you mind trying again? I made some updates on master.
https://github.com/musm/WinRPM.jl

[bmharsha]

Do you mind trying again?

I tried again, download errors are now gone, we just have following warning

WARNING: skipping repodata/repomd.xml, not in cache -- call WinRPM.update() to download

Here is the full log
https://gist.github.com/bmharsha/c79def27220871a7e85243103daf83ae#file-winrpm_musm_fix-md

[musm]

Ok so it looks like that works fine? Not sure why the links are cached anyways, as I too have run in into this problem in the past.

It looks like the WinRPM download function is flakey when it comes to url redirects.

[bmharsha]

Ok so it looks like that works fine?

Yes, it works. Thank you @musm , are you planning to send a PR from your fork, shall I close this PR?

[musm]

That suggests we should use powershell for download since it seems to properly handle redirects

[musm]

#118 same issue again...

[musm]

I think we should move quick to fix this (the appveyor builds in HDF5 are super flaky too)
@tkelman My preference is to add powershell to the download function in Base then add it to Compat and then use that here. Is that ok or do you want to do something else to fix this issue?

[musm]

OTOH it would be a lot quicker to add the change here first (1 PR vs 3 PRs)

[musm]

@bmharsha opened here #122

[bmharsha]

Closing this PR in favor of #122 , thanks @musm