File tree Expand file tree Collapse file tree 5 files changed +22
-5
lines changed Expand file tree Collapse file tree 5 files changed +22
-5
lines changed Original file line number Diff line number Diff line change
1
+ .. note ::
2
+
3
+ When specifying the
4
+ :datalakeconf: `~databases.[n].collections.[n].dataSources.[n].path `, use the
5
+ delimiter specified in :datalakeconf: `~stores.[n].delimiter `.
Original file line number Diff line number Diff line change @@ -110,7 +110,7 @@ Parameters
110
110
111
111
* - ``delimiter``
112
112
- string
113
- - Character used to define the separation of elements in the ``prefix`` .
113
+ - Character used to separate path segments in the {+data-lake-store+} .
114
114
If ommitted, defaults to ``"/"``.
115
115
- no
116
116
Original file line number Diff line number Diff line change @@ -378,8 +378,15 @@ The {+data-lake-short+} configuration file has the following format:
378
378
379
379
.. datalakeconf:: stores.[n].delimiter
380
380
381
- *Optional.* Delimiter that defines the separation of elements in the
382
- :datalakeconf:`~stores.[n].prefix`.
381
+ *Optional.* The delimiter that separates
382
+ :datalakeconf:`databases.[n].collections.[n].dataSources.[n].path`
383
+ segments in the {+data-lake-store+}. |data-lake| uses the delimiter
384
+ to efficiently traverse |s3| buckets with a hierarchical directory
385
+ structure. You can specify any character supported by the |s3| `object
386
+ keys <https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingMetadata.html>`__
387
+ as the delimiter. For example, you can specify an underscore (``_``) or a
388
+ plus sign (``+``) or multiple characters such as double underscores (``__``)
389
+ as the delimiter.
383
390
384
391
If omitted, defaults to ``"/"``.
385
392
@@ -586,6 +593,8 @@ The {+data-lake-short+} configuration file has the following format:
586
593
587
594
See :ref:`datalake-path-syntax` for more information.
588
595
596
+ .. include:: /includes/fact-path-delimiter.rst
597
+
589
598
.. datalakeconf:: databases.[n].collections.[n].dataSources.[n].defaultFormat
590
599
591
600
*Optional.* Specifies the default format {+data-lake-short+} assumes
Original file line number Diff line number Diff line change @@ -88,6 +88,8 @@ to the following:
88
88
In the above example, ``startDate`` is interpreted as a string. For more
89
89
information on all supported data types, see :ref:`datalake-path-attribute-types`.
90
90
91
+ .. include:: /includes/fact-path-delimiter.rst
92
+
91
93
.. _datalake-path-syntax-egs:
92
94
93
95
Examples
Original file line number Diff line number Diff line change @@ -8,11 +8,12 @@ Supported Partition Attribute Types
8
8
9
9
.. include:: /includes/fact-data-lake-beta.rst
10
10
11
- The following table lists the supported data types for partition attributes
12
- in the :datalakeconf:`~databases.[n].collections.[n].dataSources.[n].path` and
11
+ The following table lists the supported data types for partition attributes and
13
12
an example :datalakeconf:`~databases.[n].collections.[n].dataSources.[n].path`
14
13
for each data type:
15
14
15
+ .. include:: /includes/fact-path-delimiter.rst
16
+
16
17
.. list-table::
17
18
:header-rows: 1
18
19
:widths: 10 30 60
You can’t perform that action at this time.
0 commit comments