Julia v1.5.0 JULIA_HISTORY with line not starting with # or \t hangs at startup due to MethodError

[Nosferican]

When upgrading the cluster from v1.3.1 to v1.5.0 at startup it will hang unresponsive after

MethodError: objects of type Bool are not callable

It seems to have also occurred to @ianshmean

In my case, I thought it might have been related to Revise or having startup.jl but commenting those out didn't resolve the issue. I was able to get it working by deleting ~/.julia and then Julia started up normally. From the Slack conversation, it seems the issue is with Julia trying to create some directory that fails when it already exists and then runs into a MethodError.

CC: @giordano

[JeffBezanson]

Is there any more output, e.g. stacktrace?

[Nosferican]

It just hangs unresponsive.

[giordano]

On Slack (https://julialang.slack.com/archives/C6A044SQH/p1596398523190000) @ianshmean pointed to setup_interface in REPL/src/REPL.jl:869 with Julia v1.4.2 (but that was maybe slightly unrelated?)

[IanButterworth]

For me I had a rogue setting of env var TEMP to a nonexistant path, which threw a mktempdir() error on 1.4.2, but on 1.5 & master I got the same hanging with MethodError: objects of type Bool are not callable, until I fixed that.

I can't promise that that's not a red-herring though.. I can't replicate this with TMP=/nonexistant julia

[KristofferC]

If this is a general issue, let's hope someone figures out a way to replicate it. Until then, I don't think there is much that can be done here though. I also tried various combinations of deleting .julia and setting the environment variable but nothing replicated it.

[Nosferican]

I was able to get this stacktrace now when connecting to a computing node (login node works fine).

~MethodError: ERROR: objects of type MethodError: objects of type Bool are not callableBool
Stacktrace: are not callable

 [1] setup_interface(::REPL.LineEditREPL, ::Bool, ::Any) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/REPL/src/REPL.jl:964
 [2] setup_interface(::REPL.LineEditREPL; hascolor::Bool, extra_repl_keymap::Any) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/REPL/src/REPL.jl:872
 [3] setup_interface at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/REPL/src/REPL.jl:872 [inlined]
 [4] hook_repl at /home/jbs3hp/.vscode-server/extensions/julialang.language-julia-1.0.2/scripts/packages/VSCodeServer/src/repl.jl:66 [inlined]
 [5] (::VSCodeServer.var"#2#4"{REPL.LineEditREPL})() at ./task.jl:356

Calling Julia from the shell directly hangs with

MethodError: objects of type Bool are not callable

[Nosferican]

Here is my report:

In Julia v1.3.1 when the JULIA_HISTORY had a line where it was expected to start with a tab but didn't it would throw:

ERROR: Invalid history file ($JULIA_HISTORY) format:
If you have a history file left over from an older version of Julia,
try renaming or deleting it.
Invalid character: '{some character}' at line {ln}
Stacktrace:
 [1] error(::String, ::String, ::String, ::Int64) at ./error.jl:42
 [2] hist_from_file(::Any, ::Any, ::Any) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.3/REPL/src/REPL.jl:424
 [3] setup_interface(::REPL.LineEditREPL, ::Bool, ::Any) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.3/REPL/src/REPL.jl:864
 [4] #setup_interface#45(::Bool, ::Any, ::typeof(REPL.setup_interface), ::REPL.LineEditREPL) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.3/REPL/src/REPL.jl:769
 [5] setup_interface at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.3/REPL/src/REPL.jl:769 [inlined]
 [6] (::Pkg.var"#1#2")(::REPL.LineEditREPL) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.3/Pkg/src/Pkg.jl:432
 [7] __atreplinit(::REPL.LineEditREPL) at ./client.jl:338
 [8] #invokelatest#1 at ./essentials.jl:709 [inlined]
 [9] invokelatest at ./essentials.jl:708 [inlined]
 [10] _atreplinit at ./client.jl:345 [inlined]
 [11] (::Base.var"#770#772"{Bool,Bool,Bool,Bool})(::Module) at ./client.jl:381
 [12] #invokelatest#1 at ./essentials.jl:709 [inlined]
 [13] invokelatest at ./essentials.jl:708 [inlined]
 [14] run_main_repl(::Bool, ::Bool, ::Bool, ::Bool, ::Bool) at ./client.jl:366
 [15] exec_options(::Base.JLOptions) at ./client.jl:304
 [16] _start() at ./client.jl:460

but would proceed fine otherwise.

In v1.5.0, rather than triggering the error / warning it goes to

MethodError: objects of type Bool are not callable

which hangs. After the SIGINT

^Cfatal: error thrown and no exception handler available.
InterruptException()
jl_mutex_unlock at /buildworker/worker/package_linux64/build/src/locks.h:143 [inlined]
jl_task_get_next at /buildworker/worker/package_linux64/build/src/partr.c:476
poptask at ./task.jl:704
wait at ./task.jl:712 [inlined]
task_done_hook at ./task.jl:442
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2214 [inlined]
jl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2398
jl_apply at /buildworker/worker/package_linux64/build/src/julia.h:1690 [inlined]
jl_finish_task at /buildworker/worker/package_linux64/build/src/task.c:198
start_task at /buildworker/worker/package_linux64/build/src/task.c:717
unknown function (ip: (nil))

You may ask, how could the JULIA_HISTORY not have the tab in the lines it should have it? Here is a case,

bash-4.2$julia
               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.5.0 (2020-08-01)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/                   |

julia> run(`ijob -A biocomplexity -p bii -t 0-00:01:00 -c 1 --mem=6GB`)
salloc: Pending job allocation 13694008
salloc: job 13694008 queued and waiting for resources
salloc: job 13694008 has been allocated resources
salloc: Granted job allocation 13694008
srun: Step created for job 13694008
bash-4.2$julia
               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.5.0 (2020-08-01)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/                   |

julia> pwd()
"/sfs/qumulo/qhome/jbs3hp/.julia"

julia> exit()
bash-4.2$exit
exit
salloc: Relinquishing job allocation 13694008
salloc: Job allocation 13694008 has been revoked.
Process(`ijob -A biocomplexity -p bii -t 0-00:01:00 -c 1 --mem=6GB`, ProcessExited(0))

julia> exit()

Produces

# time: 2020-08-04 03:58:25 AST
# mode: julia
	run(`ijob -A biocomplexity -p bii -t 0-00:01:00 -c 1 --mem=6GB`)
�����������������������������������������������������������������������������������������������������������# time: 2020-08-04 03:59:13 AST
# mode: julia
	exit()

MRE:

Create a file with to pass through the JULIA_HISTORY environmental variable (edit joinpath(homedir(), ".julia", "logs", "repl_history.jl")) with

# time: 2020-08-04 03:58:25 AST
# mode: julia
 this has a space instead of a tab and Julia v1.5.0 really does not like it

[KristofferC]

It's a confusion between a local variable called hascolor (which is a Bool) and a function called hascolor.

[IanButterworth]

It's a confusion between a local variable called hascolor (which is a Bool) and a function called hascolor.

Is there a workaround for this in 1.5.0? I just hit it in a system that wasn't erroring with 1.5.0 previously

[IanButterworth]

Deleting .julia/logs/repl_history.jl works as a workaround