Skip to content

Copy normalisers for keyword fields to rollup indexes #30996

@colings86

Description

@colings86

At the moment rollups do not copy normalisers for keyword fields over to the rollup index. This means that will the introduction of #30973 enabling the match query to be used against rollup indexes the match query will work differently on live indexes to rollup indexes. The difference will be that a match query against a keyword field in a live index will get a configured normaliser applied to the query text and will match documents, but running the same query against a rollup index will potentially not match documents because the normaliser will not be applied to the query text.

For example:
If I have a field that has a lowercasing normaliser on the live index and do a rollup search across live and rollup indexes for mySQL, it will find documents in the live index and return them but it will look like there are no matching documents in the rollup index because the same normalisation was not applied on the rollup index.

We should make a change to the index side of rollups to copy over any normalisers that are configure on keyword fields we are using in the rollups.

Metadata

Metadata

Assignees

No one assigned

    Labels

    :StorageEngine/RollupTurn fine-grained time-based data into coarser-grained data>enhancementTeam:AnalyticsMeta label for analytical engine team (ESQL/Aggs/Geo)

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions