Precompiling LibSndFile on Windows 10 fails

[algo99]

Just installed Julia on Windows 10 and activated a new environment. Trying to add the first package:

               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.7.1 (2021-12-22)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/                   |

(@sp) pkg> st
      Status `D:\zkr\.julia\environments\sp\Project.toml` (empty project)
(@sp) pkg> add LibSndFile
...
  40 dependencies successfully precompiled in 27 seconds (14 already precompiled)
  1 dependency errored. To see a full report either run `import Pkg; Pkg.precompile()` or load the package

julia> using LibSndFile
[ Info: Precompiling LibSndFile [b13ce0c6-77b0-50c6-a2db-140568b8d1a5]
ERROR: LoadError: InitError: could not load library "D:\zkr\.julia\artifacts\d47144117f21db09ca9658dcd2767bed9d6ff67b\bin\libsndfile.dll"
The specified procedure could not be found.
Stacktrace:
  [1] dlopen(s::String, flags::UInt32; throw_error::Bool)
    @ Base.Libc.Libdl .\libdl.jl:117
  [2] dlopen(s::String, flags::UInt32)
    @ Base.Libc.Libdl .\libdl.jl:117
  [3] macro expansion
    @ D:\zkr\.julia\packages\JLLWrappers\bkwIo\src\products\library_generators.jl:54 [inlined]
  [4] __init__()
    @ libsndfile_jll D:\zkr\.julia\packages\libsndfile_jll\8LyEY\src\wrappers\x86_64-w64-mingw32.jl:22
  [5] _include_from_serialized(path::String, depmods::Vector{Any})
    @ Base .\loading.jl:768
  [6] _require_search_from_serialized(pkg::Base.PkgId, sourcepath::String)
    @ Base .\loading.jl:854
  [7] _require(pkg::Base.PkgId)
    @ Base .\loading.jl:1097
  [8] require(uuidkey::Base.PkgId)
    @ Base .\loading.jl:1013
  [9] require(into::Module, mod::Symbol)
    @ Base .\loading.jl:997
 [10] include
    @ .\Base.jl:418 [inlined]
 [11] include_package_for_output(pkg::Base.PkgId, input::String, depot_path::Vector{String}, dl_load_path::Vector{String}, load_path::Vector{String}, concrete_deps::Vector{Pair{Base.PkgId, UInt64}}, source::Nothing)
    @ Base .\loading.jl:1318
 [12] top-level scope
    @ none:1
 [13] eval
    @ .\boot.jl:373 [inlined]
 [14] eval(x::Expr)
    @ Base.MainInclude .\client.jl:453
 [15] top-level scope
    @ none:1
during initialization of module libsndfile_jll
in expression starting at D:\zkr\.julia\packages\LibSndFile\kDrKU\src\LibSndFile.jl:1
ERROR: Failed to precompile LibSndFile [b13ce0c6-77b0-50c6-a2db-140568b8d1a5] to D:\zkr\.julia\compiled\v1.7\LibSndFile\jl_8792.tmp.
Stacktrace:
 [1] error(s::String)
   @ Base .\error.jl:33
 [2] compilecache(pkg::Base.PkgId, path::String, internal_stderr::IO, internal_stdout::IO, ignore_loaded_modules::Bool)
   @ Base .\loading.jl:1466
 [3] compilecache(pkg::Base.PkgId, path::String)
   @ Base .\loading.jl:1410
 [4] _require(pkg::Base.PkgId)
   @ Base .\loading.jl:1120
 [5] require(uuidkey::Base.PkgId)
   @ Base .\loading.jl:1013
 [6] require(into::Module, mod::Symbol)
   @ Base .\loading.jl:997

julia>

Maybe it's relevant information but after installation I set an environment variable
JULIA_DEPOT_PATH=D:\zkr\.julia

[nantonel]

Maybe related to #50

Could you please check if by adding package in master the error persists? e.g. pkg> add LibSndFile#master

[algo99]

The same error
... could not load library "D:\zkr\.julia\artifacts\d47144117f21db09ca9658dcd2767bed9d6ff67b\bin\libsndfile.dll

It looks for me as a usual Windows problem of not found dependencies.
libsndfile.dll depends on libFLAC-x.dll, libvorbis-x.dll and so on. Is it possible to check which path Julia do use to search for dependent DLLs when it tries to load some DLL?

[nantonel]

This is the recipe that is used to build libsndfile. On Julia 1.6 tests were not failing on windows...

[justinjhlo]

I hope I wasn't doing anything wrong, but I've also been encountering this exact same error on Windows 10 on Julia 1.6.3 (the error also persists when I tried to add package in master)...

[algo99]

I checked if all dependencies-DLLs of libsndfile.dll are in place. It looks like libFLAC-8.dll needs libssp-0.dll but the later one is missing anywhere else in D:\zkr\.julia\.

It could be the reason why the libsndfile.dll load fails.

[justinjhlo]

Is it again something to do with libsndfile-v1.0.31? I just tried downgrading libsndfile_jll to v1.0.28+2 following #47 (comment) and that seems to have resolved the issue for me.

[algo99]

After some more investigation, libssp-0.dll is actually in c:\Program Files\Julia-1.7.1\bin\. So it's probably not the case.
But I think the problem definitely lies on libsndfile.dll alone or rather how it was built. Because if I replace D:\zkr\.julia\artifacts\d47144117f21db09ca9658dcd2767bed9d6ff67b\bin\libsndfile.dll with libsndfile.dll from my local MSYS-MinGW64 installation (mingw-w64-x86_64-libsndfile-1.0.31-1) then the reported error disappears.

[nantonel]

Looks like the LibSndFile recipe was changed in Yggdrasil. @justinjhlo could you try to downgrade only to libsndfile-v1.0.31+1 and see if works? Can't really check that since I have no Windows machine. If libsndfile-v1.0.31+1 works fine it means that something went wrong in the above Yggdraslig pull request and perhaps you could try opening an issue/PR there.

[nantonel]

Test were passing on windows last month with libsndfile-v1.0.31+1

[justinjhlo]

Yes indeed. Downgrading to libsndfile-v1.0.31+1 is working for me - I'll try opening an issue there. Thanks!

[giordano]

@algo99 After you do using LibSndFile and get the error about not being able to load libsndfile, in the same session, do

using DependencyWalker
Library(raw"D:\zkr\.julia\artifacts\d47144117f21db09ca9658dcd2767bed9d6ff67b\bin\libsndfile.dll")

and please post here the output. Note that you'll need to install DependencyWalker

[algo99]

I just first removed everything under D:\zkr\.julia\ and tried then from scratch as you ask.

julia> using DependencyWalker

julia> Library(raw"D:\zkr\.julia\artifacts\d47144117f21db09ca9658dcd2767bed9d6ff67b\bin\libsndfile.dll")
◼ D:\zkr\.julia\artifacts\d47144117f21db09ca9658dcd2767bed9d6ff67b\bin\libsndfile.dll
  ✗ libFLAC-8.dll (NOT FOUND)
  ✗ libogg-0.dll (NOT FOUND)
  ◼ C:\WINDOWS\System32\msvcrt.dll
    ◼ C:\WINDOWS\System32\KERNELBASE.dll
  ✗ libvorbisenc-2.dll (NOT FOUND)
  ✗ libvorbis-0.dll (NOT FOUND)
  ◼ C:\WINDOWS\System32\KERNEL32.DLL
    ◼ C:\WINDOWS\System32\KERNELBASE.dll
  ✗ libopus-0.dll (NOT FOUND)
julia>

I should mention here that if manually add all missing libraries to the D:\zkr\.julia\artifacts\d47144117f21db09ca9658dcd2767bed9d6ff67b\bin\ directory and try to run one of executables located there, I get an error message, e.g. sndfile-info.exe --help:

So I guess the problem is not just libraries path related.