Skip to content

Commit d6e1db9

Browse files
committed
HADOOP-19051: Highlight Capacity Scheduler new features in release for the release 3.4.0
1 parent ac471d7 commit d6e1db9

File tree

1 file changed

+21
-0
lines changed

1 file changed

+21
-0
lines changed

hadoop-project/src/site/markdown/index.md.vm

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -57,6 +57,27 @@ We have enhanced the YARN Federation functionality for improved usability. The e
5757
6. The page function of the router has been enhanced.
5858
7. A set of commands has been added to the Router side for operating on SubClusters and Policies.
5959

60+
YARN Capacity Scheduler improvements
61+
----------------------------------------
62+
63+
[YARN-10496](https://issues.apache.org/jira/browse/YARN-10496) Support Flexible Auto Queue Creation in Capacity Scheduler
64+
65+
Capacity Scheduler resource distribution mode was extended with a new allocation mode called weight mode.
66+
Defining queue capacities with weights allows the users to use the newly added flexible queue auto creation mode.
67+
Flexible mode now supports the dynamic creation of both **parent queues** and **leaf queues**, enabling the creation of
68+
complex queue hierarchies application submission time.
69+
70+
[YARN-10888](https://issues.apache.org/jira/browse/YARN-10888) New capacity modes for Capacity Scheduler
71+
72+
Capacity Scheduler's resource distribution was completely refactored to be more flexible and extensible. There is a new concept
73+
called Capacity Vectors, which allows the users to mix various resource types in the hierarchy, and also in a single queue. With
74+
this optionally enabled feature it is now possible to define different resources with different units, like memory with GBs, vcores with
75+
percentage values, and GPUs/FPGAs with weights, all in the same queue.
76+
77+
[YARN-10889](https://issues.apache.org/jira/browse/YARN-10889) Queue Creation in Capacity Scheduler - Various improvements
78+
79+
In addition to the two new features above, there were a number of commits for improvements and bug fixes in Capacity Scheduler.
80+
6081
HDFS RBF: Code Enhancements, New Features, and Bug Fixes
6182
----------------------------------------
6283

0 commit comments

Comments
 (0)