Skip to content

Add tt cluster reference #4046

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Feb 20, 2024
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
240 changes: 234 additions & 6 deletions doc/reference/tooling/tt_cli/cluster.rst
Original file line number Diff line number Diff line change
@@ -1,10 +1,238 @@
.. _tt-cluster:
.. _tt-cluster2:

Managing a cluster's configuration
==================================
Managing cluster configurations
===============================

.. code-block:: console
.. code-block:: console

$ tt cluster
$ tt cluster COMMAND {APPLICATION[:APP_INSTANCE] | URI} [FILE] [OPTION ...]

.. TODO: https://github.com/tarantool/doc/issues/3725
``tt cluster`` manages :ref:`YAML configurations <configuration>` of Tarantool applications.
This command works both with local configuration files in application directories
and with centralized configuration storages (:ref:`etcd <configuration_etcd>` or Tarantool-based).

``COMMAND`` is one of the following:

* ``publish``: publish a cluster configuration using an arbitrary YAML file as a source.
* ``show``: print a cluster configuration.


.. _tt-cluster-local:

Managing local configurations
-----------------------------

``tt cluster`` can read and modify local cluster configurations stored in
``config.yaml`` files inside application directories.

To write a configuration to a local ``config.yaml``, run ``tt cluster publish``
with two arguments:

* the application name.
* the path to a YAML file from which the configuration should be taken.

.. code-block:: console

$ tt cluster publish myapp source.yaml

To print a local configuration from an application's ``config.yaml``, run
``tt cluster show`` with the application name:

.. code-block:: console

$ tt cluster show myapp

.. _tt-cluster-centralized:

Managing configurations in centralized storages
-----------------------------------------------

``tt cluster`` can manage centralized cluster configurations in storages of both
supported types: :ref:`etcd <configuration_etcd>` or a Tarantool-based configuration storage.

To publish a configuration from a file to a centralized configuration storage,
run ``tt cluster publish`` with a URI of this storage's
instance as the target. For example, the command below publishes a configuration from ``source.yaml``
to a local etcd instance running on the default port ``2379``:

.. code-block:: console

$ tt cluster publish "http://localhost:2379/myapp" source.yaml

A URI must include a prefix that is unique for the application. It can also include
credentials and other connection parameters. Find the detailed description of the
URI format in :ref:`tt-cluster-centralized-uri`.

To print a cluster configuration from a centralized storage, run ``tt cluster show``
with a storage URI including the prefix identifying the application. For example, to print
``myapp``'s configuration from a local etcd storage:

.. code-block:: console

$ tt cluster show "http://localhost:2379/myapp"

.. _tt-cluster-centralized-authentication:

Authentication
~~~~~~~~~~~~~~

There are three ways to pass the credentials for connecting to the centralized configuration storage.
They all apply to both etcd and Tarantool-based storages. The following list
shows these ways ordered by precedence, from highest to lowest:

#. Credentials specified in the storage URI: ``https://username:password@host:port/prefix``:

.. code-block:: console

$ tt cluster show "http://myuser:p4$$w0rD@localhost:2379/myapp"


#. ``tt cluster`` options ``-u``/``--username`` and ``-p``/``--password``:

.. code-block:: console

$ tt cluster show "http://localhost:2379/myapp" -u myuser -p p4$$w0rD

#. Environment variables ``TT_CLI_ETCD_USERNAME`` and ``TT_CLI_ETCD_PASSWORD``:

.. code-block:: console

$ export TT_CLI_ETCD_USERNAME=myuser
$ export TT_CLI_ETCD_PASSWORD=p4$$w0rD
$ tt cluster show "http://localhost:2379/myapp"

If connection encryption is enabled on the configuration storage, pass the required
SSL parameters in the :ref:`URI arguments <tt-cluster-centralized-uri>`.

.. _tt-cluster-centralized-uri:

URI format
~~~~~~~~~~

A URI of the cluster configuration storage has the following format:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

An idea from the top of my head (maybe I'm wrong here): move the entire URI format section to reference and keep only How-to info here. So, the reference might include two levels:

  • Reference
    • Options
    • URI format

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The idea is generally OK but I don't see much benefit.


.. code-block:: text

http(s)://[username:password@]host:port[/prefix][?arguments]

* ``username`` and ``password`` define credentials for connecting to the configuration storage.
* ``prefix`` is a base path identifying a specific application in the storage.
* ``arguments`` defines connection parameters. The following arguments are available:

* ``name`` -- a name of an instance in the cluster configuration.
* ``key`` -- a target configuration key in the specified ``prefix``.
* ``timeout`` -- a request timeout in seconds. Default: ``3.0``.
* ``ssl_key_file`` -- a path to a private SSL key file.
* ``ssl_cert_file`` -- a path to an SSL certificate file.
* ``ssl_ca_file`` -- a path to a trusted certificate authorities (CA) file.
* ``ssl_ca_path`` -- a path to a trusted certificate authorities (CA) directory.
* ``verify_host`` -- verify the certificate’s name against the host. Default ``true``.
* ``verify_peer`` -- verify the peer’s SSL certificate. Default ``true``.

.. _tt-cluster-instance:

Managing configurations of specific instances
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cool, didn't know about this feature before

---------------------------------------------

In addition to whole cluster configurations, ``tt cluster`` can manage
configurations of specific instances within applications. In this case, it operates
with YAML fragments that describe a single :ref:`instance configuration section <configuration_overview>`.
For example, the following YAML file can be a source when publishing an instance configuration:

.. code-block:: yaml

# instance_source.yaml
iproto:
listen:
- uri: 127.0.0.1:3311

To send an instance configuration to a local ``config.yaml``, run ``tt cluster publish``
with the ``application:instance`` pair as the target argument:

.. code-block:: console

$ tt cluster publish myapp:instance-002 instance_source.yaml

To send an instance configuration to a centralized configuration storage, specify
the instance name in the ``name`` argument of the storage URI:

.. code-block:: console

$ tt cluster publish "http://localhost:2379/myapp?name=instance-002" instance_source.yaml

``tt cluster show`` can print configurations of specific cluster instances as well.
To print an instance configuration from a local ``config.yaml``, use the ``application:instance``
argument:

.. code-block:: console

$ tt cluster show myapp:instance-002

To print an instance configuration from a centralized configuration storage, specify
the instance name in the ``name`` argument of the URI:

.. code-block:: console

$ tt cluster show "http://localhost:2379/myapp?name=instance-002"

.. _tt-cluster-validation:

Configuration validation
------------------------

``tt cluster`` can validate configurations against the Tarantool configuration schema.

``tt cluster publish`` automatically performs the validation and aborts in case of an error.
To skip the validation, add the ``--force`` option:

.. code-block:: console

$ tt cluster publish myapp source.yaml --force

To validate configurations when printing them with ``tt cluster show``, enable the
validation by adding the ``--validate`` option:

.. code-block:: console

$ tt cluster show "http://localhost:2379/myapp" --validate


.. _tt-cluster-options:

Options
-------

.. option:: -u, --username STRING

A username for connecting to the configuration storage.
Copy link
Contributor

@andreyaksenov andreyaksenov Feb 19, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The embedded help tells:

username (used as etcd credentials only)

Shouldn't we mention that this is applicable to etcd only? The same for -p.

We can also think about mentioning about environment variables in the Options reference (like we do in config options).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, these descriptions in command help are outdated, I've checked with @ oleg-jukovec


See also: :ref:`tt-cluster-centralized-authentication`.

.. option:: -p, --password STRING

A password for connecting to the configuration storage.

See also: :ref:`tt-cluster-centralized-authentication`.

.. option:: --force

**Applicable to:** ``publish``

Skip validation when publishing. Default: `false` (validation is enabled).

.. option:: --validate

**Applicable to:** ``show``

Validate the printed configuration. Default: `false` (validation is disabled).

.. option:: --with-integrity-check STRING

.. admonition:: Enterprise Edition
:class: fact

This option is supported by the `Enterprise Edition <https://www.tarantool.io/compare/>`_ only.

**Applicable to:** ``publish``

Generate hashes and signatures for integrity checks.