Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
171 changes: 164 additions & 7 deletions docs/reference/cat/transforms.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -6,23 +6,180 @@

Returns configuration and usage information about {transforms}.


[[cat-transforms-api-request]]
==== {api-request-title}

`GET /_cat/transforms/<transform_id>` +

`GET /_cat/transforms/_all` +

`GET /_cat/transforms/*` +

`GET /_cat/transforms`

[[cat-transforms-api-prereqs]]
==== {api-prereq-title}

* If the {es} {security-features} are enabled, you must have `monitor_transform`
cluster privileges to use this API. The built-in `transform_user` role has these
privileges. For more information, see <<security-privileges>> and
<<built-in-roles>>.

//[[cat-transforms-api-desc]]
//==== {api-description-title}

[[cat-transforms-api-path-params]]
==== {api-path-parms-title}

`<transform_id>`::
(Optional, string)
include::{docdir}/rest-api/common-parms.asciidoc[tag=transform-id-wildcard]

[[cat-transforms-api-query-params]]
==== {api-query-parms-title}

`allow_no_match`::
(Optional, boolean)
include::{docdir}/rest-api/common-parms.asciidoc[tag=allow-no-match-transforms1]

include::{docdir}/rest-api/common-parms.asciidoc[tag=http-format]

`from`::
(Optional, integer)
include::{docdir}/rest-api/common-parms.asciidoc[tag=from-transforms]

include::{docdir}/rest-api/common-parms.asciidoc[tag=cat-h]
+
If you do not specify which columns to include, the API returns the default
columns. If you explicitly specify one or more columns, it returns only the
specified columns.
+
Valid columns are:

`changes_last_detection_time`, `cldt`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=checkpointing-changes-last-detected-at]

`checkpoint_duration_time_exp_avg`, `cdtea`, `checkpointTimeExpAvg`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=exponential-avg-checkpoint-duration-ms]

`create_time`, `ct`, `createTime`:::
(Default)
The time the {transform} was created.

`description`, `d`:::
(Default)
The description of the {transform}.

`dest_index`, `di`, `destIndex`:::
(Default)
include::{docdir}/rest-api/common-parms.asciidoc[tag=dest-index]

`document_total`, `dt`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=docs-processed]

`frequency`, `f`:::
(Default)
include::{docdir}/rest-api/common-parms.asciidoc[tag=frequency]

`id`:::
(Default)
include::{docdir}/rest-api/common-parms.asciidoc[tag=transform-id]

`index_failure`, `if`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=index-failures]

`index_time`, `itime`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=index-time-ms]

`index_total`, `it`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=index-total]

`indexed_documents_exp_avg`, `idea`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=exponential-avg-documents-indexed]

`invocation_total`, `itotal`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=trigger-count]

`max_page_search_size`, `mpsz`:::
(Default)
include::{docdir}/rest-api/common-parms.asciidoc[tag=pivot-max-page-search-size]

`page_total`, `pt`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=pages-processed]

`pipeline`, `p`:::
(Default)
include::{docdir}/rest-api/common-parms.asciidoc[tag=dest-pipeline]

`processed_documents_exp_avg`, `pdea`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=exponential-avg-documents-processed]

`reason`, `r`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=state-transform-reason]

`search_failure`, `sf`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=search-failures]

`search_time`, `stime`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=search-time-ms]

`search_total`, `st`:::
include::{docdir}/rest-api/common-parms.asciidoc[tag=search-total]

`source_index`, `si`, `sourceIndex`:::
(Default)
include::{docdir}/rest-api/common-parms.asciidoc[tag=source-index-transforms]

`state`, `s`:::
(Default)
include::{docdir}/rest-api/common-parms.asciidoc[tag=state-transform]

`transform_type`, `tt`:::
(Default)
Indicates the type of {transform}: `batch` or `continuous`.

`version`, `v`:::
(Default)
The version of {es} that existed on the node when the {transform} was
created.

include::{docdir}/rest-api/common-parms.asciidoc[tag=help]

include::{docdir}/rest-api/common-parms.asciidoc[tag=cat-s]

`size`::
(Optional, integer)
include::{docdir}/rest-api/common-parms.asciidoc[tag=size-transforms]

include::{docdir}/rest-api/common-parms.asciidoc[tag=time]

//[[cat-transforms-api-query-params]]
//==== {api-query-parms-title}
include::{docdir}/rest-api/common-parms.asciidoc[tag=cat-v]

[[cat-transforms-api-examples]]
==== {api-examples-title}

//[[cat-transforms-api-response-codes]]
//==== {api-response-codes-title}
[source,console]
--------------------------------------------------
GET /_cat/transforms?v&format=json
--------------------------------------------------
// TEST[skip:kibana sample data]

//[[cat-transforms-api-examples]]
//==== {api-examples-title}
[source,console-result]
----
[
{
"id" : "ecommerce_transform",
"create_time" : "2020-03-20T20:31:25.077Z",
"version" : "7.7.0",
"source_index" : "kibana_sample_data_ecommerce",
"dest_index" : "kibana_sample_data_ecommerce_transform",
"pipeline" : null,
"description" : "Maximum priced ecommerce data by customer_id in Asia",
"transform_type" : "continuous",
"frequency" : "5m",
"max_page_search_size" : "500",
"state" : "STARTED"
}
]
----
// TESTRESPONSE[skip:kibana sample data]
5 changes: 0 additions & 5 deletions docs/reference/redirects.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -385,8 +385,3 @@ coming::[7.x]
=== Component template APIs

coming::[7.x]

[role="exclude",id="cat-transform"]
=== cat transform API

See <<cat-transforms>>.
79 changes: 79 additions & 0 deletions docs/reference/rest-api/common-parms.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -99,6 +99,10 @@ tag::bytes[]
(Optional, <<byte-units,byte size units>>) Unit used to display byte values.
end::bytes[]

tag::checkpointing-changes-last-detected-at[]
The timestamp when changes were last detected in the source indices.
end::checkpointing-changes-last-detected-at[]

tag::cluster-health-status[]
(string)
Health status of the cluster, based on the state of its primary and replica
Expand Down Expand Up @@ -178,6 +182,11 @@ is based on Lucene documents. {es} reclaims the disk space of deleted Lucene
documents when a segment is merged.
end::docs-deleted[]

tag::docs-processed[]
The number of documents that have been processed from the source index of
the {transform}.
end::docs-processed[]

tag::enrich-policy[]
Enrich policy name
used to limit the request.
Expand Down Expand Up @@ -207,6 +216,20 @@ Wildcard expressions are not accepted.
--
end::expand-wildcards[]

tag::exponential-avg-checkpoint-duration-ms[]
Exponential moving average of the duration of the checkpoint, in milliseconds.
end::exponential-avg-checkpoint-duration-ms[]

tag::exponential-avg-documents-indexed[]
Exponential moving average of the number of new documents that have been
indexed.
end::exponential-avg-documents-indexed[]

tag::exponential-avg-documents-processed[]
Exponential moving average of the number of documents that have been
processed.
end::exponential-avg-documents-processed[]

tag::field_statistics[]
`field_statistics`::
(Optional, boolean) If `true`, the response includes the document count, sum of document frequencies,
Expand Down Expand Up @@ -380,6 +403,18 @@ tag::index[]
used to limit the request.
end::index[]

tag::index-failures[]
The number of indexing failures.
end::index-failures[]

tag::index-time-ms[]
The amount of time spent indexing, in milliseconds.
end::index-time-ms[]

tag::index-total[]
The number of indices created.
end::index-total[]

tag::bulk-index[]
`_index`::
(Optional, string)
Expand Down Expand Up @@ -574,6 +609,11 @@ tag::pipeline[]
(Optional, string) ID of the pipeline to use to preprocess incoming documents.
end::pipeline[]

tag::pages-processed[]
The number of search or bulk index operations processed. Documents are
processed in batches instead of individually.
end::pages-processed[]

tag::path-pipeline[]
`<pipeline>`::
(Optional, string) Comma-separated list or wildcard expression of pipeline IDs
Expand Down Expand Up @@ -706,13 +746,25 @@ tag::scroll_size[]
Defaults to 100.
end::scroll_size[]

tag::search-failures[]
The number of search failures.
end::search-failures[]

tag::search-time-ms[]
The amount of time spent searching, in milliseconds.
end::search-time-ms[]

tag::search_timeout[]
`timeout`::
(Optional, <<time-units, time units>>)
Explicit timeout for each search request.
Defaults to no timeout.
end::search_timeout[]

tag::search-total[]
The number of search operations on the source index for the {transform}.
end::search-total[]

tag::search_type[]
`search_type`::
(Optional, string) The type of the search operation. Available options:
Expand Down Expand Up @@ -802,6 +854,26 @@ A query clause that retrieves a subset of data from the source index. See
<<query-dsl>>.
end::source-query-transforms[]

tag::state-transform[]
The status of the {transform}, which can be one of the following values:
+
--
* `aborting`: The {transform} is aborting.
* `failed`: The {transform} failed. For more information about the failure,
check the reason field.
* `indexing`: The {transform} is actively processing data and creating new
documents.
* `started`: The {transform} is running but not actively indexing data.
* `stopped`: The {transform} is stopped.
* `stopping`: The {transform} is stopping.
--
end::state-transform[]

tag::state-transform-reason[]
If a {transform} has a `failed` state, this property provides details about the
reason for the failure.
end::state-transform-reason[]

tag::stats[]
`stats`::
(Optional, string) Specific `tag` of the request for logging and statistical
Expand Down Expand Up @@ -897,6 +969,13 @@ expression. If you do not specify one of these options, the API returns
information for all {transforms}.
end::transform-id-wildcard[]

tag::trigger-count[]
The number of times the {transform} has been triggered by the scheduler. For
example, the scheduler triggers the {transform} indexer to check for updates
or ingest new data at an interval specified in the
<<put-transform-request-body,`frequency` property>>.
end::trigger-count[]

tag::cat-v[]
`v`::
(Optional, boolean) If `true`, the response includes column headings.
Expand Down
Loading