-
Notifications
You must be signed in to change notification settings - Fork 25.6k
Description
#43767 moved indexer_state into checkpointing.next, and it has been pointed out that this means it is only available when a checkpoint is in progress.
From an end user perspective the difference between task_state and indexer_state is an internal implementation detail. But for debugging purposes we might want to see it even when there isn't a checkpoint in progress. If we move it to the top level then as an end user I'm back to wondering which of task_state and indexer_state I should be taking notice of, and why there are two states in the first place. A better alternative is to have just one top level state that combines the two, like anomaly detection jobs and datafeeds have. It can be defined as:
failedif what's currently reported astask_stateisfailedstoppedif there is no persistent task- Otherwise what's currently reported as
indexer_state
To avoid multiple breaking changes to the stats format in consecutive versions and complex BWC this change should be made for 7.4.