Skip to content

Conversation

@original-brownbear
Copy link
Contributor

  • Moves all pipeline state into the ingest service
    • Retains the existing pipeline store and pipeline execution service as inner classes to make the review easier, they should be flattened out in the next step
    • All tests for these classes were copied (and adapted) to the ingest service tests
  • This is a refactoring step to enable a clean implementation of a pipeline processor (See INGEST: Add Pipeline Processor #32473)

* Moves all pipeline state into the ingest service
   * Retains the existing pipeline store and pipeline execution service as inner classes to make the review easier, they should be flattened out in the next step
   * All tests for these classes were copied (and adapted) to the ingest service tests
* This is a refactoring step to enable a clean implementation of a pipeline processor (See elastic#32473)
@original-brownbear original-brownbear added WIP :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP v7.0.0 >refactoring labels Aug 3, 2018
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra

Copy link
Member

@rjernst rjernst left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we really need to keep classes for PipelineExecutionService and PipelineStore? What I meant by my original suggestion was to actually fold the implementation/methods of these classes into IngestService.

Also, /cc @martijnvg who should review as he is more familiar with why these were built as separate services in the first place.

@original-brownbear
Copy link
Contributor Author

@rjernst <= 🎂

on to business:

See my PR description, the only reason I did it this way was to make it easier to review. I was gonna fold those together for sure in the next step, the classes just introduce a bunch of complication without benefit outside of making the review easier here imo.

@original-brownbear
Copy link
Contributor Author

@martijnvg see #32473 (comment) for the motivation behind this.

@original-brownbear
Copy link
Contributor Author

Jenkins test this

@original-brownbear
Copy link
Contributor Author

@martijnvg can you take a look here please? :)

Copy link
Member

@martijnvg martijnvg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@original-brownbear LGTM. I just got back from vacation :)

There was no particular reason why these services were separated classes, encapsulating PipelineExecutionService and PipelineStore into IngestService make sense to me.

@original-brownbear
Copy link
Contributor Author

@martijnvg right (with the vacation thing), sorry for being annoying and thanks for the review! :)

Merging then, will further flatten this out like suggested by @rjernst in a follow up :)

@original-brownbear original-brownbear merged commit 8fc213f into elastic:master Aug 21, 2018
@original-brownbear original-brownbear deleted the real-ingest-service branch August 21, 2018 03:05
original-brownbear added a commit to original-brownbear/elasticsearch that referenced this pull request Aug 21, 2018
* Follow up to elastic#32617
* Flatten redundant inner classes of `IngestService`
original-brownbear added a commit that referenced this pull request Aug 21, 2018
* INGEST: Simplify IngestService

* Follow up to #32617
* Flatten redundant inner classes of `IngestService`
original-brownbear added a commit to original-brownbear/elasticsearch that referenced this pull request Aug 31, 2018
* INGEST: Simplify IngestService

* Follow up to elastic#32617
* Flatten redundant inner classes of `IngestService`
original-brownbear added a commit that referenced this pull request Sep 4, 2018
* INGEST: Simplify IngestService (#33008)
* Follow up to #32617
* Flatten redundant inner classes of `IngestService`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >refactoring v6.5.0 v7.0.0-beta1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants