Skip to content

Conversation

@felixbarny
Copy link
Member

@felixbarny felixbarny commented Jul 6, 2021

An alternative to #74957

This is to support creating an ingest pipeline for ECS JSON logs.

Merging instead of putAll is important as Filebeat sets values for data_stream.type, data_stream.dataset, and data_stream.namespace. If the logs override just one, such as data_stream.dataset, currently, the whole data_stream namespace would be overridden.

@felixbarny felixbarny added >enhancement :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP v8.0.0 Team:Data Management Meta label for data/management team v7.15.0 labels Jul 6, 2021
@felixbarny felixbarny requested a review from martijnvg July 6, 2021 12:39
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-features (Team:Core/Features)

@elasticsearchmachine elasticsearchmachine added the external-contributor Pull request authored by a developer outside the Elasticsearch team label Jul 6, 2021
@felixbarny felixbarny added the auto-backport Automatically create backport pull requests when merged label Jul 6, 2021
Copy link
Member

@martijnvg martijnvg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some comments.
@danhermann would also want to take a look at this pr?

@martijnvg martijnvg requested a review from danhermann July 7, 2021 08:57
Copy link
Contributor

@danhermann danhermann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added some comments, primarily about naming, below. Naming is hard.

@felixbarny felixbarny changed the title Json processor: add_to_root_merge_strategy option Json processor: add_to_root_conflict_strategy option Jul 8, 2021
@danhermann
Copy link
Contributor

Thanks, LGTM. 👍

@elasticsearchmachine
Copy link
Collaborator

💚 Backport successful

Status Branch Result
7.x

@felixbarny felixbarny deleted the json-add_to_root_merge_strategy branch July 8, 2021 12:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-backport Automatically create backport pull requests when merged :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >enhancement external-contributor Pull request authored by a developer outside the Elasticsearch team Team:Data Management Meta label for data/management team v7.15.0 v8.0.0-alpha1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants