From 7a0a57664780384ad99ffe0f516999ef7778b8ed Mon Sep 17 00:00:00 2001 From: tom lee Date: Thu, 18 Nov 2021 21:34:09 +0800 Subject: [PATCH 1/3] HDFS-16335. Fix HDFSCommands.md --- .../src/site/markdown/HDFSCommands.md | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md index df333ef51ecc8..a2bf915583c89 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md @@ -298,7 +298,7 @@ Usage: | `-include -f` \ \| \ | Includes only the specified datanodes to be balanced by the balancer. | | `-source -f` \ \| \ | Pick only the specified datanodes as source nodes. | | `-blockpools` \ | The balancer will only run on blockpools included in this list. | -| `-idleiterations` \ | Maximum number of idle iterations before exit. This overwrites the default idleiterations(5). | +| `-idleiterations` \ | Maximum number of idle iterations before exit. This overwrites the default idle iterations(5). | | `-runDuringUpgrade` | Whether to run the balancer during an ongoing HDFS upgrade. This is usually not desired since it will not affect used space on over-utilized machines. | | `-asService` | Run Balancer as a long running service. | | `-hotBlockTimeInterval` | Prefer moving cold blocks i.e blocks associated with files accessed or modified before the specified time interval. | @@ -306,11 +306,11 @@ Usage: Runs a cluster balancing utility. An administrator can simply press Ctrl-C to stop the rebalancing process. See [Balancer](./HdfsUserGuide.html#Balancer) for more details. -Note that the `blockpool` policy is more strict than the `datanode` policy. +Note that the `blockpool` policy is stricter than the `datanode` policy. Besides the above command options, a pinning feature is introduced starting from 2.7.0 to prevent certain replicas from getting moved by balancer/mover. This pinning feature is disabled by default, and can be enabled by configuration property "dfs.datanode.block-pinning.enabled". When enabled, this feature only affects blocks that are written to favored nodes specified in the create() call. This feature is useful when we want to maintain the data locality, for applications such as HBase regionserver. -If you want to run Balancer as a long running service, please start Balancer using `-asService` parameter with daemon-mode. You can do this by using the following command: `hdfs --daemon start balancer -asService`, or just use sbin/start-balancer.sh script with parameter `-asService`. +If you want to run Balancer as a long-running service, please start Balancer using `-asService` parameter with daemon-mode. You can do this by using the following command: `hdfs --daemon start balancer -asService`, or just use sbin/start-balancer.sh script with parameter `-asService`. ### `cacheadmin` @@ -463,7 +463,7 @@ Usage: | COMMAND\_OPTION | Description | |:---- |:---- | | `-add` *source* *nameservices* *destination* | Add a mount table entry or update if it exists. | -| `-update` *source* *nameservices* *destination* | Update a mount table entry attribures. | +| `-update` *source* *nameservices* *destination* | Update a mount table entry attributes. | | `-rm` *source* | Remove mount point of specified path. | | `-ls` `[-d]` *path* | List mount points under specified path. Specify -d parameter to get detailed listing.| | `-getDestination` *path* | Get the subcluster where a file is or should be created. | @@ -496,7 +496,7 @@ Usage: | COMMAND\_OPTION | Description | |:---- |:---- | -|-plan| Creates a disbalancer plan| +|-plan| Creates a diskbalancer plan| |-execute| Executes a given plan on a datanode| |-query| Gets the current diskbalancer status from a datanode| |-cancel| Cancels a running plan| @@ -567,7 +567,7 @@ See [HDFS HA with NFS](./HDFSHighAvailabilityWithNFS.html#Administrative_command Usage: `hdfs journalnode` -This comamnd starts a journalnode for use with [HDFS HA with QJM](./HDFSHighAvailabilityWithQJM.html#Administrative_commands). +This command starts a journalnode for use with [HDFS HA with QJM](./HDFSHighAvailabilityWithQJM.html#Administrative_commands). ### `mover` @@ -622,13 +622,13 @@ Runs the namenode. More info about the upgrade and rollback is at [Upgrade Rollb Usage: `hdfs nfs3` -This comamnd starts the NFS3 gateway for use with the [HDFS NFS3 Service](./HdfsNfsGateway.html#Start_and_stop_NFS_gateway_service). +This command starts the NFS3 gateway for use with the [HDFS NFS3 Service](./HdfsNfsGateway.html#Start_and_stop_NFS_gateway_service). ### `portmap` Usage: `hdfs portmap` -This comamnd starts the RPC portmap for use with the [HDFS NFS3 Service](./HdfsNfsGateway.html#Start_and_stop_NFS_gateway_service). +This command starts the RPC portmap for use with the [HDFS NFS3 Service](./HdfsNfsGateway.html#Start_and_stop_NFS_gateway_service). ### `secondarynamenode` @@ -666,7 +666,7 @@ Usage: `hdfs zkfc [-formatZK [-force] [-nonInteractive]]` | `-formatZK` | Format the Zookeeper instance. -force: formats the znode if the znode exists. -nonInteractive: formats the znode aborts if the znode exists, unless -force option is specified. | | `-h` | Display help | -This comamnd starts a Zookeeper Failover Controller process for use with [HDFS HA with QJM](./HDFSHighAvailabilityWithQJM.html#Administrative_commands). +This command starts a Zookeeper Failover Controller process for use with [HDFS HA with QJM](./HDFSHighAvailabilityWithQJM.html#Administrative_commands). Debug Commands -------------- From f44946d2b02e0e1993ca4bd8a45b33b4ad7ac39b Mon Sep 17 00:00:00 2001 From: tom lee Date: Fri, 19 Nov 2021 21:08:41 +0800 Subject: [PATCH 2/3] update doc --- .../hadoop-hdfs/src/site/markdown/HDFSCommands.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md index a2bf915583c89..921cecc156403 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md @@ -298,7 +298,7 @@ Usage: | `-include -f` \ \| \ | Includes only the specified datanodes to be balanced by the balancer. | | `-source -f` \ \| \ | Pick only the specified datanodes as source nodes. | | `-blockpools` \ | The balancer will only run on blockpools included in this list. | -| `-idleiterations` \ | Maximum number of idle iterations before exit. This overwrites the default idle iterations(5). | +| `-idleiterations` \ | Maximum number of idle iterations before exit. This overwrites the default idleiterations(5). | | `-runDuringUpgrade` | Whether to run the balancer during an ongoing HDFS upgrade. This is usually not desired since it will not affect used space on over-utilized machines. | | `-asService` | Run Balancer as a long running service. | | `-hotBlockTimeInterval` | Prefer moving cold blocks i.e blocks associated with files accessed or modified before the specified time interval. | @@ -750,7 +750,7 @@ Mount link: mount target uri for /user: hdfs://MyCluster2/user --> ``` - + If user wants to talk to `hdfs://MyCluster2/`, then they can pass -fs option (`-fs hdfs://MyCluster1/user`) Since /user was mapped to a cluster `hdfs://MyCluster2/user`, dfsadmin resolve the passed (`-fs hdfs://MyCluster1/user`) to target fs (`hdfs://MyCluster2/user`). This way users can get the access to all hdfs child file systems in ViewFsOverloadScheme. From 96722321c7318cf0c11497a043f9c919f90bfc76 Mon Sep 17 00:00:00 2001 From: tom lee Date: Fri, 19 Nov 2021 21:35:54 +0800 Subject: [PATCH 3/3] update doc --- .../hadoop-hdfs/src/site/markdown/HDFSCommands.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md index 921cecc156403..a11f209870550 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md @@ -750,7 +750,7 @@ Mount link: mount target uri for /user: hdfs://MyCluster2/user --> ``` - + If user wants to talk to `hdfs://MyCluster2/`, then they can pass -fs option (`-fs hdfs://MyCluster1/user`) Since /user was mapped to a cluster `hdfs://MyCluster2/user`, dfsadmin resolve the passed (`-fs hdfs://MyCluster1/user`) to target fs (`hdfs://MyCluster2/user`). This way users can get the access to all hdfs child file systems in ViewFsOverloadScheme.