Support for ghc-8.10.1

[mouse07410]

Fails. With "normal" Cabal config - fails to construct dependency tree:

$ ghc --version
The Glorious Glasgow Haskell Compilation System, version 8.10.1
$ ./cabal-hie-install hie-8.10.1
Warning: Unknown/unsupported 'ghc' version detected (Cabal 3.0.0.0 supports
'ghc' version < 8.10): /Users/ur20980/.ghcup/bin/ghc is version 8.10.1
Resolving dependencies...
cabal: Could not resolve dependencies:
[__0] trying: fake-package-0 (user goal)
[__1] trying: base-4.14.0.0/installed-4.1... (dependency of fake-package)
[__2] trying: hie-install-0.8.1.0 (user goal)
[__3] trying: hie-install:-run-from-stack
[__4] next goal: cabal-install-parsers (dependency of hie-install
-run-from-stack)
[__4] rejecting: cabal-install-parsers-0.2, cabal-install-parsers-0.1
(conflict: base==4.14.0.0/installed-4.1..., cabal-install-parsers =>
base>=4.10 && <4.14)
[__4] fail (backjumping, conflict set: base, cabal-install-parsers,
hie-install, hie-install:run-from-stack)
After searching the rest of the dependency tree exhaustively, these were the
goals I've had most trouble fulfilling: base, cabal-install-parsers,
hie-install, hie-install:run-from-stack, fake-package
Try running with --minimize-conflict-set to improve the error message.

If --allow-newer: True is set:

$ ./cabal-hie-install hie-8.10.1
Resolving dependencies...
Build profile: -w ghc-8.10.1 -O1
In order, the following will be built (use -v for more details):
 - binary-orphans-1.0.1 (lib) (requires build)
 - base-compat-0.11.1 (lib) (requires build)
 - base-orphans-0.8.2 (lib) (requires build)
 - base16-bytestring-0.1.1.6 (lib:base16-bytestring) (requires build)
 - clock-0.8 (lib) (requires build)
 - cryptohash-sha256-0.11.101.0 (lib) (requires build)
 - dlist-0.8.0.7 (lib) (requires build)
 - heaps-0.3.6.1 (lib) (requires build)
 - hsc2hs-0.68.7 (exe:hsc2hs) (requires build)
 - hashable-1.3.0.0 (lib) (requires build)
 - js-dgtable-0.5.2 (lib) (requires build)
 - js-flot-0.8.3 (lib) (requires build)
 - js-jquery-3.3.1 (lib) (requires build)
 - integer-logarithms-1.0.3 (lib) (requires build)
 - network-uri-2.6.3.0 (lib) (requires build)
 - primitive-0.7.0.1 (lib) (requires build)
 - random-1.1 (lib) (requires build)
 - semigroups-0.19.1 (lib) (requires build)
 - utf8-string-1.0.1.1 (lib:utf8-string) (requires build)
 - tagged-0.8.6 (lib) (requires build)
 - th-abstraction-0.3.2.0 (lib) (requires build)
 - tar-0.5.1.1 (lib) (requires build)
 - text-binary-0.2.1.1 (lib:text-binary) (requires build)
 - base-compat-batteries-0.11.1 (lib) (requires build)
 - time-compat-1.9.3 (lib) (requires build)
 - lukko-0.1.1.2 (lib) (requires download & build)
 - unordered-containers-0.2.10.0 (lib) (requires build)
 - case-insensitive-1.2.1.0 (lib) (requires build)
 - vector-0.12.1.2 (lib) (requires build)
 - scientific-0.3.6.2 (lib) (requires build)
 - uuid-types-1.0.3 (lib) (requires build)
 - extra-1.7.1 (lib) (requires build)
 - vector-binary-instances-0.2.5.1 (lib) (requires build)
 - attoparsec-0.13.2.3 (lib) (requires build)
 - filepattern-0.1.2 (lib) (requires build)
 - aeson-1.4.7.1 (lib) (requires download & build)
 - shake-0.18.5 (lib) (requires build)
 - binary-instances-1.0.0.1 (lib) (requires download & build)
 - cabal-install-parsers-0.2 (lib) (requires build)
 - hie-install-0.8.1.0 (lib) (first run)
 - fake-package-0 (exe:script) (first run)
Downloading  lukko-0.1.1.2
Starting     base16-bytestring-0.1.1.6 (all, legacy fallback)
Starting     binary-orphans-1.0.1 (lib)
Starting     base-orphans-0.8.2 (lib)
Starting     base-compat-0.11.1 (lib)
Downloaded   lukko-0.1.1.2
Downloading  aeson-1.4.7.1
Downloaded   aeson-1.4.7.1
Downloading  binary-instances-1.0.0.1
Downloaded   binary-instances-1.0.0.1
Building     base-orphans-0.8.2 (lib)
Haddock      base-orphans-0.8.2 (lib)
Building     base16-bytestring-0.1.1.6 (all, legacy fallback)
Building     base-compat-0.11.1 (lib)
Installing   base-orphans-0.8.2 (lib)
Building     binary-orphans-1.0.1 (lib)
Haddock      base16-bytestring-0.1.1.6 (all, legacy fallback)
Haddock      binary-orphans-1.0.1 (lib)
Installing   base16-bytestring-0.1.1.6 (all, legacy fallback)
Completed    base-orphans-0.8.2 (lib)
Starting     clock-0.8 (lib)
Installing   binary-orphans-1.0.1 (lib)
Completed    base16-bytestring-0.1.1.6 (all, legacy fallback)
Starting     cryptohash-sha256-0.11.101.0 (lib)
Completed    binary-orphans-1.0.1 (lib)
Starting     dlist-0.8.0.7 (lib)
Building     clock-0.8 (lib)
Building     dlist-0.8.0.7 (lib)
Haddock      dlist-0.8.0.7 (lib)
Building     cryptohash-sha256-0.11.101.0 (lib)
Haddock      clock-0.8 (lib)
Installing   dlist-0.8.0.7 (lib)
Completed    dlist-0.8.0.7 (lib)
Starting     heaps-0.3.6.1 (lib)
Installing   clock-0.8 (lib)
Completed    clock-0.8 (lib)
Starting     hsc2hs-0.68.7 (exe:hsc2hs)
Haddock      base-compat-0.11.1 (lib)
Haddock      cryptohash-sha256-0.11.101.0 (lib)
Building     heaps-0.3.6.1 (lib)
Installing   cryptohash-sha256-0.11.101.0 (lib)
Building     hsc2hs-0.68.7 (exe:hsc2hs)
Completed    cryptohash-sha256-0.11.101.0 (lib)
Starting     hashable-1.3.0.0 (lib)
Building     hashable-1.3.0.0 (lib)
Installing   base-compat-0.11.1 (lib)
Completed    base-compat-0.11.1 (lib)
Starting     js-dgtable-0.5.2 (lib)
Haddock      heaps-0.3.6.1 (lib)
Haddock      hashable-1.3.0.0 (lib)
Installing   heaps-0.3.6.1 (lib)
Installing   hashable-1.3.0.0 (lib)
Completed    heaps-0.3.6.1 (lib)
Starting     js-flot-0.8.3 (lib)
Building     js-dgtable-0.5.2 (lib)
Completed    hashable-1.3.0.0 (lib)
Starting     js-jquery-3.3.1 (lib)
Haddock      js-dgtable-0.5.2 (lib)
Installing   js-dgtable-0.5.2 (lib)
Building     js-flot-0.8.3 (lib)
Installing   hsc2hs-0.68.7 (exe:hsc2hs)
Completed    hsc2hs-0.68.7 (exe:hsc2hs)
Building     js-jquery-3.3.1 (lib)
Starting     integer-logarithms-1.0.3 (lib)
Completed    js-dgtable-0.5.2 (lib)
Starting     network-uri-2.6.3.0 (lib)
Haddock      js-jquery-3.3.1 (lib)
Installing   js-jquery-3.3.1 (lib)
Building     integer-logarithms-1.0.3 (lib)
Building     network-uri-2.6.3.0 (lib)
Completed    js-jquery-3.3.1 (lib)
Starting     primitive-0.7.0.1 (lib)
Haddock      integer-logarithms-1.0.3 (lib)
Building     primitive-0.7.0.1 (lib)
Installing   integer-logarithms-1.0.3 (lib)
Haddock      js-flot-0.8.3 (lib)
Completed    integer-logarithms-1.0.3 (lib)
Starting     random-1.1 (lib)
Installing   js-flot-0.8.3 (lib)
Completed    js-flot-0.8.3 (lib)
Starting     semigroups-0.19.1 (lib)
Building     random-1.1 (lib)
Building     semigroups-0.19.1 (lib)
Haddock      semigroups-0.19.1 (lib)
Haddock      network-uri-2.6.3.0 (lib)
Installing   semigroups-0.19.1 (lib)
Completed    semigroups-0.19.1 (lib)
Starting     utf8-string-1.0.1.1 (all, legacy fallback)
Installing   network-uri-2.6.3.0 (lib)
Completed    network-uri-2.6.3.0 (lib)
Starting     tagged-0.8.6 (lib)
Building     utf8-string-1.0.1.1 (all, legacy fallback)
Haddock      random-1.1 (lib)
Building     tagged-0.8.6 (lib)
Installing   random-1.1 (lib)
Completed    random-1.1 (lib)
Starting     th-abstraction-0.3.2.0 (lib)
Haddock      primitive-0.7.0.1 (lib)
Haddock      utf8-string-1.0.1.1 (all, legacy fallback)
Haddock      tagged-0.8.6 (lib)
Building     th-abstraction-0.3.2.0 (lib)
Installing   utf8-string-1.0.1.1 (all, legacy fallback)
Installing   tagged-0.8.6 (lib)
Completed    utf8-string-1.0.1.1 (all, legacy fallback)
Starting     tar-0.5.1.1 (lib)
Completed    tagged-0.8.6 (lib)
Starting     text-binary-0.2.1.1 (all, legacy fallback)
Installing   primitive-0.7.0.1 (lib)
Building     tar-0.5.1.1 (lib)
Building     text-binary-0.2.1.1 (all, legacy fallback)
Completed    primitive-0.7.0.1 (lib)
Starting     time-compat-1.9.3 (lib)
Haddock      text-binary-0.2.1.1 (all, legacy fallback)
Installing   text-binary-0.2.1.1 (all, legacy fallback)
Building     time-compat-1.9.3 (lib)
Completed    text-binary-0.2.1.1 (all, legacy fallback)
Starting     base-compat-batteries-0.11.1 (lib)
Building     base-compat-batteries-0.11.1 (lib)
Haddock      th-abstraction-0.3.2.0 (lib)
Haddock      time-compat-1.9.3 (lib)
Installing   th-abstraction-0.3.2.0 (lib)
Installing   time-compat-1.9.3 (lib)
Completed    th-abstraction-0.3.2.0 (lib)
Starting     unordered-containers-0.2.10.0 (lib)
Completed    time-compat-1.9.3 (lib)
Starting     case-insensitive-1.2.1.0 (lib)
Building     unordered-containers-0.2.10.0 (lib)
Haddock      tar-0.5.1.1 (lib)
Building     case-insensitive-1.2.1.0 (lib)
Haddock      case-insensitive-1.2.1.0 (lib)
Installing   case-insensitive-1.2.1.0 (lib)
Completed    case-insensitive-1.2.1.0 (lib)
Starting     lukko-0.1.1.2 (lib)
Haddock      base-compat-batteries-0.11.1 (lib)
Installing   tar-0.5.1.1 (lib)
Completed    tar-0.5.1.1 (lib)
Starting     extra-1.7.1 (lib)
Building     extra-1.7.1 (lib)
Installing   base-compat-batteries-0.11.1 (lib)
Building     lukko-0.1.1.2 (lib)
Completed    base-compat-batteries-0.11.1 (lib)
Starting     uuid-types-1.0.3 (lib)
Haddock      lukko-0.1.1.2 (lib)
Installing   lukko-0.1.1.2 (lib)
Haddock      extra-1.7.1 (lib)
Completed    lukko-0.1.1.2 (lib)
Starting     vector-0.12.1.2 (lib)
Building     uuid-types-1.0.3 (lib)
Installing   extra-1.7.1 (lib)
Building     vector-0.12.1.2 (lib)
Completed    extra-1.7.1 (lib)
Starting     scientific-0.3.6.2 (lib)
Haddock      uuid-types-1.0.3 (lib)
Building     scientific-0.3.6.2 (lib)
Installing   uuid-types-1.0.3 (lib)
Completed    uuid-types-1.0.3 (lib)
Starting     filepattern-0.1.2 (lib)
Haddock      unordered-containers-0.2.10.0 (lib)
Building     filepattern-0.1.2 (lib)
Installing   unordered-containers-0.2.10.0 (lib)
Completed    unordered-containers-0.2.10.0 (lib)
Haddock      filepattern-0.1.2 (lib)
Haddock      scientific-0.3.6.2 (lib)
Installing   filepattern-0.1.2 (lib)
Installing   scientific-0.3.6.2 (lib)
Completed    filepattern-0.1.2 (lib)
Starting     shake-0.18.5 (lib)
Completed    scientific-0.3.6.2 (lib)
Starting     attoparsec-0.13.2.3 (lib)
Building     shake-0.18.5 (lib)
Building     attoparsec-0.13.2.3 (lib)
Haddock      attoparsec-0.13.2.3 (lib)
Installing   attoparsec-0.13.2.3 (lib)
Completed    attoparsec-0.13.2.3 (lib)
Haddock      shake-0.18.5 (lib)
Installing   shake-0.18.5 (lib)
Completed    shake-0.18.5 (lib)
Haddock      vector-0.12.1.2 (lib)
Installing   vector-0.12.1.2 (lib)
Completed    vector-0.12.1.2 (lib)
Starting     vector-binary-instances-0.2.5.1 (lib)
Starting     aeson-1.4.7.1 (lib)
Building     vector-binary-instances-0.2.5.1 (lib)
Building     aeson-1.4.7.1 (lib)
Haddock      vector-binary-instances-0.2.5.1 (lib)
Installing   vector-binary-instances-0.2.5.1 (lib)
Completed    vector-binary-instances-0.2.5.1 (lib)
Haddock      aeson-1.4.7.1 (lib)
Installing   aeson-1.4.7.1 (lib)
Completed    aeson-1.4.7.1 (lib)
Starting     binary-instances-1.0.0.1 (lib)
Building     binary-instances-1.0.0.1 (lib)
Haddock      binary-instances-1.0.0.1 (lib)
Installing   binary-instances-1.0.0.1 (lib)
Completed    binary-instances-1.0.0.1 (lib)
Starting     cabal-install-parsers-0.2 (lib)
Building     cabal-install-parsers-0.2 (lib)

Failed to build cabal-install-parsers-0.2.
Build log (
/Users/ur20980/.cabal/logs/ghc-8.10.1/cbl-nstll-prsrs-0.2-7495a92a.log ):
Configuring library for cabal-install-parsers-0.2..
Preprocessing library for cabal-install-parsers-0.2..
Building library for cabal-install-parsers-0.2..
[1 of 9] Compiling Cabal.Internal.Glob ( src/Cabal/Internal/Glob.hs, dist/build/Cabal/Internal/Glob.o, dist/build/Cabal/Internal/Glob.dyn_o )
[2 of 9] Compiling Cabal.Internal.Newtypes ( src/Cabal/Internal/Newtypes.hs, dist/build/Cabal/Internal/Newtypes.o, dist/build/Cabal/Internal/Newtypes.dyn_o )
[3 of 9] Compiling Cabal.Optimization ( src/Cabal/Optimization.hs, dist/build/Cabal/Optimization.o, dist/build/Cabal/Optimization.dyn_o )
[4 of 9] Compiling Cabal.Parse      ( src/Cabal/Parse.hs, dist/build/Cabal/Parse.o, dist/build/Cabal/Parse.dyn_o )

src/Cabal/Parse.hs:34:51: error:
    • Couldn't match expected type ‘[C.PError]’
                  with actual type ‘GHC.Base.NonEmpty C.PError’
    • In the third argument of ‘ParseError’, namely ‘es’
      In the second argument of ‘($)’, namely ‘ParseError fp bs es ws’
      In the expression: Left $ ParseError fp bs es ws
   |
34 |     (ws, Left (_, es)) -> Left $ ParseError fp bs es ws
   |                                                   ^^
cabal: Failed to build cabal-install-parsers-0.2 (which is required by
exe:script from fake-package-0). See the build log above for details.

Relevant log ~/.cabal/logs/ghc-8.10.1/cbl-nstll-prsrs-0.2-7495a92a.log:
cbl-log.txt

[jneira]

Maybe the cabal.project that works with 8.8.3 could be handy: https://github.com/haskell/haskell-ide-engine/blob/c6241565568e070847b1d6f1e1a5792ddb6d9e81/cabal.project-8.8.3

[mouse07410]

Maybe the cabal.project that works with 8.8.3 could be handy...

I'm afraid it isn't - I copied it to cabal.project-8.10.1 and got the result posted above.

Thankfully, you guys did a great job with 8.8.3 - it built with 8.8.3 smoothly. But now there's 8.10.1 (and probably 8.10.2 fairly soon to follow) that we need to take care of.

[mouse07410]

It's probably obvious, but with ghc-8.10.1 installed, even ./cabal-hie-install help doesn't work:

[jneira]

Jummm, it seems a cabal-install version compiled against the Cabal library version shipped with ghc-8.10.1 is needed. So i think a cabal-install version build from source would be needed

[mouse07410]

it seems a cabal-install version compiled against the Cabal library version shipped with ghc-8.10.1 is needed. So i think a cabal-install version build from source would be needed

Yes, I concur. The problem is that it doesn't seem to build from source, no matter what I tried. See haskell/cabal#6615

[mouse07410]

@jneira I build cabal-install 3.2.0.0 following your suggestions in haskell/cabal#6615 (comment) , but attempt to build HIE still fails the same way:

$ cabal --version
cabal-install version 3.2.0.0
compiled using version 3.2.0.0 of the Cabal library 
$ ./cabal-hie-install hie-8.10.1
Resolving dependencies...
cabal: Could not resolve dependencies:
[__0] trying: fake-package-0 (user goal)
[__1] trying: base-4.14.0.0/installed-4.14.0.0 (dependency of fake-package)
[__2] trying: hie-install-0.8.1.0 (user goal)
[__3] trying: hie-install:-run-from-stack
[__4] next goal: cabal-install-parsers (dependency of hie-install
-run-from-stack)
[__4] rejecting: cabal-install-parsers-0.2 (conflict:
base==4.14.0.0/installed-4.14.0.0, cabal-install-parsers => base>=4.10 &&
<4.14)
[__4] skipping: cabal-install-parsers-0.1 (has the same characteristics that
caused the previous version to fail: excludes 'base' version 4.14.0.0)
[__4] fail (backjumping, conflict set: base, cabal-install-parsers,
hie-install, hie-install:run-from-stack)
After searching the rest of the dependency tree exhaustively, these were the
goals I've had most trouble fulfilling: base, cabal-install-parsers,
hie-install, hie-install:run-from-stack, fake-package
Try running with --minimize-conflict-set to improve the error message.

$ $ ghc-pkg list base
/Users/ur20980/.ghcup/ghc/8.10.1/lib/ghc-8.10.1/package.conf.d
    base-4.14.0.0
$ 

[jneira]

From haskell/cabal#6615 (comment) by @mouse07410

When I return to building HIE with ghc-8.10.1 support, what do I do for cabal.project-8.10.1? Do I keep the commit numbers specified in cabal.project-8.8.3, or do I comment them out to just use the master branches...?

Commits are for package versions needed to build hie with ghc-8.8.3, but not released publicly in hackage. It is probable that ghc-8.10.1 will need them or even a more recent commit with specific support for it.

[mouse07410]

Understood, thanks. It looks like I have to wait for your cabal.project-8.10.1 before proceeding with HIE build.

Update

@jneira would you be able to look into this, please? As you see above, HIE build collapses because its build tree cannot be composed - GHC-8.10.1 has/needs base 4.14.0.0, while cabal-install-parsers require base < 4.14.

Also, I don't understand why I see hie-install:-run-from-stack in the error log:

$ ./cabal-hie-install hie-8.10.1
Resolving dependencies...
cabal: Could not resolve dependencies:
[__0] trying: fake-package-0 (user goal)
[__1] trying: base-4.14.0.0/installed-4.14.0.0 (dependency of fake-package)
[__2] trying: hie-install-0.8.1.0 (user goal)
[__3] trying: hie-install:-run-from-stack
[__4] next goal: cabal-install-parsers (dependency of hie-install
-run-from-stack)
[__4] rejecting: cabal-install-parsers-0.2 (conflict:
base==4.14.0.0/installed-4.14.0.0, cabal-install-parsers => base>=4.10 &&
<4.14)
[__4] skipping: cabal-install-parsers-0.1 (has the same characteristics that
caused the previous version to fail: excludes 'base' version 4.14.0.0)
[__4] fail (backjumping, conflict set: base, cabal-install-parsers,
hie-install, hie-install:run-from-stack)
After searching the rest of the dependency tree exhaustively, these were the
goals I've had most trouble fulfilling: base, cabal-install-parsers,
hie-install, hie-install:run-from-stack, fake-package
Try running with --minimize-conflict-set to improve the error message.

[mouse07410]

@jneira from #1670 (comment)

But stack did build hie-8.8.3, though it used ghc-8.8.2 for that. Does it mean that VS Code can use hie-8.8.3 for projects that require GHC-8.8.3?

I am afraid it does not. The hie version comes from yaml files using a convention: it assumes the version in the stack-${version}.yaml file name matches the ghc version of its resolver. So you could create a stack-666.yaml and the install script would create a hie-666 executable but the ghc will continue being the defined in the resolver.

Since it seems impossible now to build HIE for GHC-8.10.1 using Cabal - I want to get back to this.

I understand that stack would use whatever GHC is configured for the specified resolver. But what if I build HIE-8.10.1 using stack and GHC-8.8.3 (which currently works), and then use that HIE with Cabal projects configured for GHC-8.10.1? Would this work? Or is HIE only useful with projects that employ exactly the same GHC as the one HIE was built with?

[jneira]

Since it seems impossible now to build HIE for GHC-8.10.1 using Cabal - I want to get back to this.

Not sure if impossible but it needs that all hie transitive dependencies (and they are a lot) have a version compatible with ghc-8.10.1. You have to pin that version using git dependencies if it is not in hackage or pest maintainers/make pr's to add support for the obsolete ones

Lot of work, more now that ghc-8.10.1 is still hot.

I want to get back to this. (stack)

That is difficult too. There is no nightly snapshot using ghc-8.10.1 so you have to make a manual setup similar to cabal one.

Or is HIE only useful with projects that employ exactly the same GHC as the one HIE was built with?

I am afraid that it is the case. hie, unlike cabal, dependes heavily on ghc at compile time, so the executable binary built is different for each ghc version, so i would not recommend use hie from a different minor version (8.6 <> 8.8 <> 8.10)

[mouse07410]

I would not recommend use hie from a different minor version (8.6 <> 8.8 <> 8.10)

I hear you, and understand all the difficulties you mentioned. :-(

Still, as there are only two options: (a) constrain to use ghc-8.8.3 only, or (b) try to use hie-8.10.1 which in fact is hie-8.8.3 because it was built with GHC-8.8.3 with projects and hope nothing big would break.

If, while all the above issues are being rectified (which probably would take some time!), I want to pursue the (b) - what consequences or pitfalls should I be looking for? Would HIE just refuse to work or break in every trivial case? Or would it be unable to recognize and deal properly with GHC 8.10.1 unique extensions, but otherwise be quite sane/usable?

[fendor]

Depending on changes in HsExpr(which I am not aware of), the parsing of modules could break.
If there was any ABI changes, the breaks will be unpredictable.
Changes in boot libs, such as array, base, containers, Cabal, etc... could cause trouble in some weird way.
HIE itself will not refuse to work, though. I dont think we really experimented if HIE behaves sanely for a different major version.