diff --git a/CHANGELOG.rst b/CHANGELOG.rst index 41bb9ea3..9d3203f0 100644 --- a/CHANGELOG.rst +++ b/CHANGELOG.rst @@ -1,9 +1,129 @@ ============================== -Cloudera.Cluster Release Notes +cloudera.cluster Release Notes ============================== .. contents:: Topics +v5.0.0 +====== + +Major Changes +------------- + +- Remove collection dependencies from legacy roles (https://github.com/cloudera-labs/cloudera.cluster/pull/324) + +Minor Changes +------------- + +- Add CM service config module and reconciliation utilities (https://github.com/cloudera-labs/cloudera.cluster/pull/257) +- Add ECS Control plane cluster functionality (https://github.com/cloudera-labs/cloudera.cluster/pull/251) +- Add External Account Module (https://github.com/cloudera-labs/cloudera.cluster/pull/264) +- Add External_user_mappings module (https://github.com/cloudera-labs/cloudera.cluster/pull/248) +- Add Host Config Module (https://github.com/cloudera-labs/cloudera.cluster/pull/234) +- Add Host Template Module (https://github.com/cloudera-labs/cloudera.cluster/pull/238) +- Add Umami tracking to header (https://github.com/cloudera-labs/cloudera.cluster/pull/318) +- Add User Module (https://github.com/cloudera-labs/cloudera.cluster/pull/252) +- Add ansible-lint configuration and remove from pre-commit hooks (https://github.com/cloudera-labs/cloudera.cluster/pull/320) +- Add api-design.md write up (https://github.com/cloudera-labs/cloudera.cluster/pull/277) +- Add cm kerberos module (https://github.com/cloudera-labs/cloudera.cluster/pull/273) +- Add cm_autotls module (https://github.com/cloudera-labs/cloudera.cluster/pull/263) +- Add control_plane and control_plane_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/312) +- Add documentation for fixture factories for integration testing (https://github.com/cloudera-labs/cloudera.cluster/pull/279) +- Add file name to JSON parsing error message (https://github.com/cloudera-labs/cloudera.cluster/pull/249) +- Add lookup plugin cm_license for parsing Cloudera Manager license files (https://github.com/cloudera-labs/cloudera.cluster/pull/274) +- Add pre-commit instructions (https://github.com/cloudera-labs/cloudera.cluster/pull/240) +- Add pytest fixtures for constructing supporting test resources (https://github.com/cloudera-labs/cloudera.cluster/pull/256) +- Add repository to Hatch docs:changelog script (https://github.com/cloudera-labs/cloudera.cluster/pull/321) +- Add retry logic on HTTP 400 errors for parcel functions (https://github.com/cloudera-labs/cloudera.cluster/pull/288) +- Add return value to wait_for_command_state (https://github.com/cloudera-labs/cloudera.cluster/pull/271) +- Data Context Module (https://github.com/cloudera-labs/cloudera.cluster/pull/246) +- Refactor service_role and service_role_info to align to current flow, utilities, and testing (https://github.com/cloudera-labs/cloudera.cluster/pull/278) +- Rename service_role and service_role_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/293) +- Rename service_role_config_group and service_role_config_group_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/294) +- Update Python shebang and documentation organization (https://github.com/cloudera-labs/cloudera.cluster/pull/290) +- Update cm_service module (https://github.com/cloudera-labs/cloudera.cluster/pull/265) +- Update collection version to 4.5.0-rc1 (https://github.com/cloudera-labs/cloudera.cluster/pull/266) +- Update configuration reconciliation logic (https://github.com/cloudera-labs/cloudera.cluster/pull/286) +- Update control_plane API documentation (https://github.com/cloudera-labs/cloudera.cluster/pull/322) +- Update copyright date (https://github.com/cloudera-labs/cloudera.cluster/pull/323) +- Update documentation and changelog management (https://github.com/cloudera-labs/cloudera.cluster/pull/292) +- Update host and host_info modules for cluster membership and role assignments (https://github.com/cloudera-labs/cloudera.cluster/pull/283) +- Update host_template module and tests (https://github.com/cloudera-labs/cloudera.cluster/pull/281) +- Update retry to timeouts for host and parcel management (https://github.com/cloudera-labs/cloudera.cluster/pull/289) +- Update service and service_info modules to align with current utilities (https://github.com/cloudera-labs/cloudera.cluster/pull/280) +- Update service_role_config_group to align with CM modules (https://github.com/cloudera-labs/cloudera.cluster/pull/272) +- Update service_role_config_group_info module to align with existing modules (https://github.com/cloudera-labs/cloudera.cluster/pull/270) +- Update to cm-client v57 (https://github.com/cloudera-labs/cloudera.cluster/pull/326) +- add test script (https://github.com/cloudera-labs/cloudera.cluster/pull/254) + +Deprecated Features +------------------- + +- Deprecate MySQL filters (https://github.com/cloudera-labs/cloudera.cluster/pull/309) +- Deprecate append_database_port filter (https://github.com/cloudera-labs/cloudera.cluster/pull/300) +- Deprecate cluster_service_role_hosts filter (https://github.com/cloudera-labs/cloudera.cluster/pull/301) +- Deprecate cm_api action (https://github.com/cloudera-labs/cloudera.cluster/pull/299) +- Deprecate default_database_port filter (https://github.com/cloudera-labs/cloudera.cluster/pull/302) +- Deprecate extract_* filters (https://github.com/cloudera-labs/cloudera.cluster/pull/303) +- Deprecate filter_null_configs filter (https://github.com/cloudera-labs/cloudera.cluster/pull/304) +- Deprecate find_clusters filter (https://github.com/cloudera-labs/cloudera.cluster/pull/305) +- Deprecate flatten_dict_list filter (https://github.com/cloudera-labs/cloudera.cluster/pull/306) +- Deprecate format_database_type filter (https://github.com/cloudera-labs/cloudera.cluster/pull/308) +- Deprecate host_config and host_config_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/298) +- Deprecate legacy roles (https://github.com/cloudera-labs/cloudera.cluster/pull/311) +- Deprecate service_config and service_config_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/297) +- Deprecate service_role_config and service_role_config_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/296) +- Deprecate service_role_config_group_config and service_role_config_group_config_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/295) +- Deprecate to_ldap_type_enum filter (https://github.com/cloudera-labs/cloudera.cluster/pull/310) +- Deprecate version filters (https://github.com/cloudera-labs/cloudera.cluster/pull/307) + +Security Fixes +-------------- + +- Add no_log to sensitive parameters (https://github.com/cloudera-labs/cloudera.cluster/pull/287) + +Bugfixes +-------- + +- Change 'tls' parameter to 'auto_tls' (https://github.com/cloudera-labs/cloudera.cluster/pull/285) +- Create Mgmt Role model utility for CMS (https://github.com/cloudera-labs/cloudera.cluster/pull/282) +- Fix external_user_mapping module (https://github.com/cloudera-labs/cloudera.cluster/pull/313) +- Hotfix/cluster module (https://github.com/cloudera-labs/cloudera.cluster/pull/244) +- Remove invalid get_host_ref() (https://github.com/cloudera-labs/cloudera.cluster/pull/284) +- Update cm_utils discover_endpoint function (https://github.com/cloudera-labs/cloudera.cluster/pull/253) +- Update normalization to use type() not isinstance() checks (https://github.com/cloudera-labs/cloudera.cluster/pull/275) +- Update version of upload-artifact action (https://github.com/cloudera-labs/cloudera.cluster/pull/269) + +New Plugins +----------- + +Lookup +~~~~~~ + +- cloudera.cluster.cm_license - Get the details of a Cloudera license. + +New Modules +----------- + +- cloudera.cluster.cm_autotls - Manage and configure Auto-TLS and Cloudera Manager CA. +- cloudera.cluster.cm_autotls_info - Retrieve Cloudera Manager configurations for Auto-TLS. +- cloudera.cluster.cm_kerberos - Manage and configure Kerberos Authentication for CDP. +- cloudera.cluster.cm_kerberos_info - Retrieve Cloudera Manager configurations for Kerberos. +- cloudera.cluster.cm_service_role - Manage a Cloudera Manager Service role. +- cloudera.cluster.cm_service_role_config_group - Manage a Cloudera Manager Service role config group. +- cloudera.cluster.cm_service_role_config_group_info - Retrieve information about Cloudera Management service role config groups. +- cloudera.cluster.cm_service_role_info - Retrieve information about Cloudera Management service roles. +- cloudera.cluster.control_plane - Manage Cloudera control planes. +- cloudera.cluster.data_context - Create, update, or delete a data context. +- cloudera.cluster.data_context_info - Retrieve details of data contexts. +- cloudera.cluster.deprecation - Display a deprecation warning. +- cloudera.cluster.external_account - Create, update, or delete an external module account. +- cloudera.cluster.external_account_info - Retrieve external account details details. +- cloudera.cluster.external_user_mappings - Create, update, or delete external user mappings. +- cloudera.cluster.external_user_mappings_info - Retrieve details of external user mappings. +- cloudera.cluster.host_template - Manage a cluster host template. +- cloudera.cluster.host_template_info - Retrieve details regarding a cluster's host templates. + v4.4.0 ====== diff --git a/changelogs/.plugin-cache.yaml b/changelogs/.plugin-cache.yaml index 82c00fb0..f3845151 100644 --- a/changelogs/.plugin-cache.yaml +++ b/changelogs/.plugin-cache.yaml @@ -219,6 +219,16 @@ plugins: name: cm_version_info namespace: '' version_added: 4.0.0 + control_plane: + description: Manage Cloudera control planes + name: control_plane + namespace: '' + version_added: 5.0.0 + control_plane_info: + description: Retrieve information about control planes + name: control_plane_info + namespace: '' + version_added: null data_context: description: Create, update, or delete a data context name: data_context @@ -229,6 +239,11 @@ plugins: name: data_context_info namespace: '' version_added: 5.0.0 + deprecation: + description: Display a deprecation warning + name: deprecation + namespace: '' + version_added: 5.0.0 external_account: description: Create, update, or delete an external module account name: external_account @@ -289,6 +304,27 @@ plugins: name: parcel_info namespace: '' version_added: 4.4.0 + role: + description: Manage a service role in cluster + name: role + namespace: '' + version_added: 4.4.0 + role_config_group: + description: Manage a cluster service role config group. + name: role_config_group + namespace: '' + version_added: 4.4.0 + role_config_group_info: + description: Retrieve information about a cluster service role config group + or groups + name: role_config_group_info + namespace: '' + version_added: 4.4.0 + role_info: + description: Retrieve information about the service roles of cluster + name: role_info + namespace: '' + version_added: 4.4.0 service: description: Manage a service in cluster name: service @@ -309,21 +345,11 @@ plugins: name: service_info namespace: '' version_added: 4.4.0 - service_role: - description: Manage a service role in cluster - name: service_role - namespace: '' - version_added: 4.4.0 service_role_config: description: Manage a service role configuration in cluster name: service_role_config namespace: '' version_added: 4.4.0 - service_role_config_group: - description: Manage a cluster service role config group. - name: service_role_config_group - namespace: '' - version_added: 4.4.0 service_role_config_group_config: description: Manage the configuration of a cluster service role config group. name: service_role_config_group_config @@ -334,23 +360,12 @@ plugins: name: service_role_config_group_config_info namespace: '' version_added: 4.4.0 - service_role_config_group_info: - description: Retrieve information about a cluster service role config group - or groups - name: service_role_config_group_info - namespace: '' - version_added: 4.4.0 service_role_config_info: description: Retrieve information about the configuration for a cluster service role name: service_role_config_info namespace: '' version_added: 4.4.0 - service_role_info: - description: Retrieve information about the service roles of cluster - name: service_role_info - namespace: '' - version_added: 4.4.0 service_type_info: description: Retrieve the service types of a cluster name: service_type_info @@ -371,4 +386,4 @@ plugins: strategy: {} test: {} vars: {} -version: 4.4.0 +version: 5.0.0 diff --git a/changelogs/changelog.yaml b/changelogs/changelog.yaml index be21805a..220e61ac 100644 --- a/changelogs/changelog.yaml +++ b/changelogs/changelog.yaml @@ -1,8 +1,155 @@ --- ancestor: releases: + 5.0.0: + changes: + bugfixes: + - Fix external_user_mapping module (https://github.com/cloudera-labs/cloudera.cluster/pull/313) + - Change 'tls' parameter to 'auto_tls' (https://github.com/cloudera-labs/cloudera.cluster/pull/285) + - Remove invalid get_host_ref() (https://github.com/cloudera-labs/cloudera.cluster/pull/284) + - Create Mgmt Role model utility for CMS (https://github.com/cloudera-labs/cloudera.cluster/pull/282) + - Update normalization to use type() not isinstance() checks (https://github.com/cloudera-labs/cloudera.cluster/pull/275) + - Update version of upload-artifact action (https://github.com/cloudera-labs/cloudera.cluster/pull/269) + - Update cm_utils discover_endpoint function (https://github.com/cloudera-labs/cloudera.cluster/pull/253) + - Hotfix/cluster module (https://github.com/cloudera-labs/cloudera.cluster/pull/244) + minor_changes: + - Update to cm-client v57 (https://github.com/cloudera-labs/cloudera.cluster/pull/326) + - Update copyright date (https://github.com/cloudera-labs/cloudera.cluster/pull/323) + - Update control_plane API documentation (https://github.com/cloudera-labs/cloudera.cluster/pull/322) + - Add repository to Hatch docs:changelog script (https://github.com/cloudera-labs/cloudera.cluster/pull/321) + - Add ansible-lint configuration and remove from pre-commit hooks (https://github.com/cloudera-labs/cloudera.cluster/pull/320) + - Add Umami tracking to header (https://github.com/cloudera-labs/cloudera.cluster/pull/318) + - Add control_plane and control_plane_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/312) + - Rename service_role_config_group and service_role_config_group_info modules + (https://github.com/cloudera-labs/cloudera.cluster/pull/294) + - Rename service_role and service_role_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/293) + - Update documentation and changelog management (https://github.com/cloudera-labs/cloudera.cluster/pull/292) + - Update Python shebang and documentation organization (https://github.com/cloudera-labs/cloudera.cluster/pull/290) + - Update retry to timeouts for host and parcel management (https://github.com/cloudera-labs/cloudera.cluster/pull/289) + - Add retry logic on HTTP 400 errors for parcel functions (https://github.com/cloudera-labs/cloudera.cluster/pull/288) + - Update configuration reconciliation logic (https://github.com/cloudera-labs/cloudera.cluster/pull/286) + - Update host and host_info modules for cluster membership and role assignments (https://github.com/cloudera-labs/cloudera.cluster/pull/283) + - Update host_template module and tests (https://github.com/cloudera-labs/cloudera.cluster/pull/281) + - Update service and service_info modules to align with current utilities + (https://github.com/cloudera-labs/cloudera.cluster/pull/280) + - Add documentation for fixture factories for integration testing (https://github.com/cloudera-labs/cloudera.cluster/pull/279) + - Refactor service_role and service_role_info to align to current flow, utilities, + and testing (https://github.com/cloudera-labs/cloudera.cluster/pull/278) + - Add api-design.md write up (https://github.com/cloudera-labs/cloudera.cluster/pull/277) + - Add lookup plugin cm_license for parsing Cloudera Manager license files + (https://github.com/cloudera-labs/cloudera.cluster/pull/274) + - Add cm kerberos module (https://github.com/cloudera-labs/cloudera.cluster/pull/273) + - Update service_role_config_group to align with CM modules (https://github.com/cloudera-labs/cloudera.cluster/pull/272) + - Add return value to wait_for_command_state (https://github.com/cloudera-labs/cloudera.cluster/pull/271) + - Update service_role_config_group_info module to align with existing modules + (https://github.com/cloudera-labs/cloudera.cluster/pull/270) + - Update collection version to 4.5.0-rc1 (https://github.com/cloudera-labs/cloudera.cluster/pull/266) + - Update cm_service module (https://github.com/cloudera-labs/cloudera.cluster/pull/265) + - Add External Account Module (https://github.com/cloudera-labs/cloudera.cluster/pull/264) + - Add cm_autotls module (https://github.com/cloudera-labs/cloudera.cluster/pull/263) + - Add CM service config module and reconciliation utilities (https://github.com/cloudera-labs/cloudera.cluster/pull/257) + - Add pytest fixtures for constructing supporting test resources (https://github.com/cloudera-labs/cloudera.cluster/pull/256) + - add test script (https://github.com/cloudera-labs/cloudera.cluster/pull/254) + - Add User Module (https://github.com/cloudera-labs/cloudera.cluster/pull/252) + - Add ECS Control plane cluster functionality (https://github.com/cloudera-labs/cloudera.cluster/pull/251) + - Add file name to JSON parsing error message (https://github.com/cloudera-labs/cloudera.cluster/pull/249) + - Add External_user_mappings module (https://github.com/cloudera-labs/cloudera.cluster/pull/248) + - Data Context Module (https://github.com/cloudera-labs/cloudera.cluster/pull/246) + - Add pre-commit instructions (https://github.com/cloudera-labs/cloudera.cluster/pull/240) + - Add Host Template Module (https://github.com/cloudera-labs/cloudera.cluster/pull/238) + - Add Host Config Module (https://github.com/cloudera-labs/cloudera.cluster/pull/234) + security_fixes: + - Add no_log to sensitive parameters (https://github.com/cloudera-labs/cloudera.cluster/pull/287) + deprecated_features: + - Deprecate legacy roles (https://github.com/cloudera-labs/cloudera.cluster/pull/311) + - Deprecate to_ldap_type_enum filter (https://github.com/cloudera-labs/cloudera.cluster/pull/310) + - Deprecate MySQL filters (https://github.com/cloudera-labs/cloudera.cluster/pull/309) + - Deprecate format_database_type filter (https://github.com/cloudera-labs/cloudera.cluster/pull/308) + - Deprecate version filters (https://github.com/cloudera-labs/cloudera.cluster/pull/307) + - Deprecate flatten_dict_list filter (https://github.com/cloudera-labs/cloudera.cluster/pull/306) + - Deprecate find_clusters filter (https://github.com/cloudera-labs/cloudera.cluster/pull/305) + - Deprecate filter_null_configs filter (https://github.com/cloudera-labs/cloudera.cluster/pull/304) + - Deprecate extract_* filters (https://github.com/cloudera-labs/cloudera.cluster/pull/303) + - Deprecate default_database_port filter (https://github.com/cloudera-labs/cloudera.cluster/pull/302) + - Deprecate cluster_service_role_hosts filter (https://github.com/cloudera-labs/cloudera.cluster/pull/301) + - Deprecate append_database_port filter (https://github.com/cloudera-labs/cloudera.cluster/pull/300) + - Deprecate cm_api action (https://github.com/cloudera-labs/cloudera.cluster/pull/299) + - Deprecate host_config and host_config_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/298) + - Deprecate service_config and service_config_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/297) + - Deprecate service_role_config and service_role_config_info modules (https://github.com/cloudera-labs/cloudera.cluster/pull/296) + - Deprecate service_role_config_group_config and service_role_config_group_config_info + modules (https://github.com/cloudera-labs/cloudera.cluster/pull/295) + major_changes: + - Remove collection dependencies from legacy roles (https://github.com/cloudera-labs/cloudera.cluster/pull/324) + modules: + - description: Manage and configure Auto-TLS and Cloudera Manager CA. + name: cm_autotls + namespace: '' + - description: Retrieve Cloudera Manager configurations for Auto-TLS. + name: cm_autotls_info + namespace: '' + - description: Manage and configure Kerberos Authentication for CDP. + name: cm_kerberos + namespace: '' + - description: Retrieve Cloudera Manager configurations for Kerberos. + name: cm_kerberos_info + namespace: '' + - description: Manage a Cloudera Manager Service role. + name: cm_service_role + namespace: '' + - description: Manage a Cloudera Manager Service role config group. + name: cm_service_role_config_group + namespace: '' + - description: Retrieve information about Cloudera Management service role config + groups. + name: cm_service_role_config_group_info + namespace: '' + - description: Retrieve information about Cloudera Management service roles. + name: cm_service_role_info + namespace: '' + - description: Manage Cloudera control planes. + name: control_plane + namespace: '' + - description: Create, update, or delete a data context. + name: data_context + namespace: '' + - description: Retrieve details of data contexts. + name: data_context_info + namespace: '' + - description: Display a deprecation warning. + name: deprecation + namespace: '' + - description: Create, update, or delete an external module account. + name: external_account + namespace: '' + - description: Retrieve external account details details. + name: external_account_info + namespace: '' + - description: Create, update, or delete external user mappings. + name: external_user_mappings + namespace: '' + - description: Retrieve details of external user mappings. + name: external_user_mappings_info + namespace: '' + - description: Manage a cluster host template. + name: host_template + namespace: '' + - description: Retrieve details regarding a cluster's host templates. + name: host_template_info + namespace: '' + plugins: + lookup: + - description: Get the details of a Cloudera license. + name: cm_license + namespace: + release_date: '2025-08-26' 4.4.0: changes: + bugfixes: + - Remove deprecated ansible.builtin.command 'warn' parameter (https://github.com/cloudera-labs/cloudera.cluster/pull/196) + - Update parcels.yml (https://github.com/cloudera-labs/cloudera.cluster/pull/189) + - Update postgresql-RedHat.yml (https://github.com/cloudera-labs/cloudera.cluster/pull/188) + - Removes blockers to running check mode & diff mode (https://github.com/cloudera-labs/cloudera.cluster/pull/166) minor_changes: - Update to version 4.4.0 (https://github.com/cloudera-labs/cloudera.cluster/pull/231) - Add workflow and steps to validate for and publishing to Ansible Galaxy @@ -24,11 +171,6 @@ releases: - Add cm_trial module (https://github.com/cloudera-labs/cloudera.cluster/pull/195) - Add CM Service Module (https://github.com/cloudera-labs/cloudera.cluster/pull/194) - Add CM Service Info Module (https://github.com/cloudera-labs/cloudera.cluster/pull/190) - bugfixes: - - Remove deprecated ansible.builtin.command 'warn' parameter (https://github.com/cloudera-labs/cloudera.cluster/pull/196) - - Update parcels.yml (https://github.com/cloudera-labs/cloudera.cluster/pull/189) - - Update postgresql-RedHat.yml (https://github.com/cloudera-labs/cloudera.cluster/pull/188) - - Removes blockers to running check mode & diff mode (https://github.com/cloudera-labs/cloudera.cluster/pull/166) modules: - description: Manage the lifecycle and state of a cluster. name: cluster diff --git a/galaxy.yml b/galaxy.yml index 06fd1f7f..c4b09a35 100644 --- a/galaxy.yml +++ b/galaxy.yml @@ -16,7 +16,7 @@ namespace: cloudera name: cluster -version: 5.0.0-rc.2 +version: 5.0.0 readme: README.md authors: - Webster Mudge @wmudge diff --git a/requirements.txt b/requirements.txt index 8381f6a7..21202ea0 100644 --- a/requirements.txt +++ b/requirements.txt @@ -12,9 +12,6 @@ # See the License for the specific language governing permissions and # limitations under the License. -# For community.general.json_query filter -jmespath - # For cm_service lookup cm-client diff --git a/requirements.yml b/requirements.yml index 53a1d6f7..45cab7ed 100644 --- a/requirements.yml +++ b/requirements.yml @@ -14,24 +14,4 @@ # See the License for the specific language governing permissions and # limitations under the License. -roles: - - name: geerlingguy.postgresql - version: 2.2.0 - - # geerlingguy.mysql with fix for issue #332 - - src: https://github.com/dbeech/ansible-role-mysql - version: master - -collections: - - name: ansible.posix - version: 1.3.0 - - name: community.crypto - version: 2.2.1 - - name: community.general - version: 4.5.0 - - name: community.mysql - version: 3.1.0 - - name: community.postgresql - version: 1.6.1 - - name: freeipa.ansible_freeipa - version: 1.11.1 +# no-op