Skip to content

Conversation

@GlenRSmith
Copy link
Contributor

Clarify documentation of json processor with a config, a sample doc, and the processed result

@clintongormley clintongormley added :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >docs General docs changes labels Nov 30, 2016
@clintongormley
Copy link
Contributor

@GlenRSmith LGTM, would be even nicer if these snippets used runnable CONSOLE snippets and included the docs tests (so we would actually confirm that the snippets run and that they return the result we're expecting) See https://github.com/elastic/elasticsearch/blob/master/docs/README.asciidoc for details

@GlenRSmith
Copy link
Contributor Author

@clintongormley Thanks for the explanatory link. I knew that feature was in play now, but nothing about implementation. This will be super helpful. But this PR failed some integration test?

@jasontedor
Copy link
Member

But this PR failed some integration test?

It was an unrelated failure, fixed by #21894.

@jasontedor
Copy link
Member

test again please

2 similar comments
@GlenRSmith
Copy link
Contributor Author

test again please

@jasontedor
Copy link
Member

test again please

@jasontedor
Copy link
Member

retest this please

1 similar comment
@GlenRSmith
Copy link
Contributor Author

retest this please

@nik9000
Copy link
Member

nik9000 commented Apr 18, 2017

@GlenRSmith, would you like to fix the merge conflict?


For example, if you have a log message which contains `ip=1.2.3.4 error=REFUSED`, you can parse those automatically by configuring:


Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to restore all the relevant markup around the examples in the kv processor.

@GlenRSmith
Copy link
Contributor Author

retest this please

@GlenRSmith
Copy link
Contributor Author

Should pass now, but still needs snippets appropriately tagged for CONSOLE and TEST as commented by @clintongormley previously.

@nik9000
Copy link
Member

nik9000 commented Apr 18, 2017

I'd love to convert the snippets, yeah, but I don't think we need to block the merge on it. If the rest of the file were all CONSOLE and you were adding non-CONSOLE snippets, sure. If you think you'll have a chance to convert them then let me know and I'll wait. Otherwise I think we should merge to get the better docs and convert when we get around to it.

I've been slowly converting the unconverted snippets and I'd get to these eventually.

@GlenRSmith
Copy link
Contributor Author

@nik9000 Then kindly merge away. I don't know when I would get to converting, and if I do get to it, well, it will be sitting there waiting.

@nik9000 nik9000 merged commit 3ff014d into master Apr 19, 2017
nik9000 pushed a commit that referenced this pull request Apr 19, 2017
Add examples for the json processor.
nik9000 pushed a commit that referenced this pull request Apr 19, 2017
Add examples for the json processor.
nik9000 pushed a commit that referenced this pull request Apr 19, 2017
Add examples for the json processor.
@nik9000
Copy link
Member

nik9000 commented Apr 19, 2017

OK @GlenRSmith! I've merged and cherry-picked to 5.x, 5.4, and 5.3.

jasontedor added a commit to jasontedor/elasticsearch that referenced this pull request Apr 19, 2017
* master:
  Add BucketMetricValue interface (elastic#24188)
  Enable index-time sorting (elastic#24055)
  Clarify elasticsearch user uid:gid mapping in Docker docs
  Update field-names-field.asciidoc (elastic#24178)
  ElectMasterService.hasEnoughMasterNodes should return false if no masters were found
  Remove Ubuntu 12.04 (elastic#24161)
  [Test] Add unit tests for InternalHDRPercentilesTests (elastic#24157)
  Replicate write failures (elastic#23314)
  Rename variable in translog simple commit test
  Strengthen translog commit with open view test
  Stronger check in translog prepare and commit test
  Fix translog prepare commit and commit test
  ingest-node.asciidoc - Clarify json processor (elastic#21876)
  Painless: more testing for script_stack (elastic#24168)
@colings86 colings86 deleted the GlenRSmith-patch-3 branch May 27, 2020 07:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >docs General docs changes v5.3.1 v5.4.0 v5.5.0 v6.0.0-alpha1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants