Skip to content

Commit 4d57cec

Browse files
DOCSP-10251 doc updates for custom delimiters in path (#23)
* DOCSP-10251 doc updates for custom delimiters in path
1 parent c70d0a8 commit 4d57cec

File tree

5 files changed

+22
-5
lines changed

5 files changed

+22
-5
lines changed
Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
.. note::
2+
3+
When specifying the
4+
:datalakeconf:`~databases.[n].collections.[n].dataSources.[n].path`, use the
5+
delimiter specified in :datalakeconf:`~stores.[n].delimiter`.

source/reference/cli/stores/create-store.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -110,7 +110,7 @@ Parameters
110110

111111
* - ``delimiter``
112112
- string
113-
- Character used to define the separation of elements in the ``prefix``.
113+
- Character used to separate path segments in the {+data-lake-store+}.
114114
If ommitted, defaults to ``"/"``.
115115
- no
116116

source/reference/config-files/data-lake-configuration.txt

Lines changed: 11 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -378,8 +378,15 @@ The {+data-lake-short+} configuration file has the following format:
378378

379379
.. datalakeconf:: stores.[n].delimiter
380380

381-
*Optional.* Delimiter that defines the separation of elements in the
382-
:datalakeconf:`~stores.[n].prefix`.
381+
*Optional.* The delimiter that separates
382+
:datalakeconf:`databases.[n].collections.[n].dataSources.[n].path`
383+
segments in the {+data-lake-store+}. |data-lake| uses the delimiter
384+
to efficiently traverse |s3| buckets with a hierarchical directory
385+
structure. You can specify any character supported by the |s3| `object
386+
keys <https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingMetadata.html>`__
387+
as the delimiter. For example, you can specify an underscore (``_``) or a
388+
plus sign (``+``) or multiple characters such as double underscores (``__``)
389+
as the delimiter.
383390

384391
If omitted, defaults to ``"/"``.
385392

@@ -586,6 +593,8 @@ The {+data-lake-short+} configuration file has the following format:
586593

587594
See :ref:`datalake-path-syntax` for more information.
588595

596+
.. include:: /includes/fact-path-delimiter.rst
597+
589598
.. datalakeconf:: databases.[n].collections.[n].dataSources.[n].defaultFormat
590599

591600
*Optional.* Specifies the default format {+data-lake-short+} assumes

source/reference/examples/path-syntax-examples.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -88,6 +88,8 @@ to the following:
8888
In the above example, ``startDate`` is interpreted as a string. For more
8989
information on all supported data types, see :ref:`datalake-path-attribute-types`.
9090

91+
.. include:: /includes/fact-path-delimiter.rst
92+
9193
.. _datalake-path-syntax-egs:
9294

9395
Examples

source/supported-unsupported/supported-partition-attributes.txt

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,11 +8,12 @@ Supported Partition Attribute Types
88

99
.. include:: /includes/fact-data-lake-beta.rst
1010

11-
The following table lists the supported data types for partition attributes
12-
in the :datalakeconf:`~databases.[n].collections.[n].dataSources.[n].path` and
11+
The following table lists the supported data types for partition attributes and
1312
an example :datalakeconf:`~databases.[n].collections.[n].dataSources.[n].path`
1413
for each data type:
1514

15+
.. include:: /includes/fact-path-delimiter.rst
16+
1617
.. list-table::
1718
:header-rows: 1
1819
:widths: 10 30 60

0 commit comments

Comments
 (0)