Skip to content

Conversation

@droberts195
Copy link

@droberts195 droberts195 commented Nov 6, 2020

This change is the Java-side companion to elastic/ml-cpp#1556.
It ensures that customisations to xpack.ml.min_disk_space_off_heap
are reflected in the disk space check done in the C++ code as well
as in the disk space check done in the Java code. The check done
in the C++ code runs later than the check in the Java code, and
only requires that 80% of the disk space required in the Java code
is available. (The defaults are 5GB and 4GB.)

Relates elastic/ml-cpp#1556
Closes elastic/ml-cpp#1554
Fixes #58806

This change is the Java-side companion to elastic/ml-cpp#1556.
It ensures that customisations to xpack.ml.min_disk_space_off_heap
are reflected in the disk space check done in the C++ code as well
as in the disk space check done in the Java code.  The check done
in the C++ code runs later than the check in the Java code, and
only requires that 80% of the disk space required in the Java code
is available.  (The defaults are 5GB and 4GB.)

Relates elastic/ml-cpp#1556
Closes elastic/ml-cpp#1554
Fixes elastic#58806
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml)

@droberts195
Copy link
Author

This is a >non-issue because xpack.ml.min_disk_space_off_heap is intentionally undocumented.

@benwtrent benwtrent self-requested a review November 6, 2020 15:03
@droberts195
Copy link
Author

@elasticmachine update branch

@droberts195 droberts195 merged commit 0c23d3a into elastic:master Nov 6, 2020
@droberts195 droberts195 deleted the pass_forecast_min_available_disk_space branch November 6, 2020 16:25
droberts195 pushed a commit to droberts195/elasticsearch that referenced this pull request Nov 6, 2020
This change is the Java-side companion to elastic/ml-cpp#1556.
It ensures that customisations to xpack.ml.min_disk_space_off_heap
are reflected in the disk space check done in the C++ code as well
as in the disk space check done in the Java code.  The check done
in the C++ code runs later than the check in the Java code, and
only requires that 80% of the disk space required in the Java code
is available.  (The defaults are 5GB and 4GB.)

Backport of elastic#64720
droberts195 pushed a commit that referenced this pull request Nov 6, 2020
…4733)

This change is the Java-side companion to elastic/ml-cpp#1556.
It ensures that customisations to xpack.ml.min_disk_space_off_heap
are reflected in the disk space check done in the C++ code as well
as in the disk space check done in the Java code.  The check done
in the C++ code runs later than the check in the Java code, and
only requires that 80% of the disk space required in the Java code
is available.  (The defaults are 5GB and 4GB.)

Backport of #64720
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[ML] Pass minimum required disk space for forecasting as a forecast parameter [CI] ForecastIT.testOverflowToDisk failing on EAR builds

4 participants