Skip to content

Branch 2.6.0 #25

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 6,667 commits into from
Closed

Branch 2.6.0 #25

wants to merge 6,667 commits into from

Conversation

@omkarksa
Copy link

@omkarksa omkarksa commented Aug 6, 2015

No description provided.

jian-he and others added 30 commits October 13, 2014 14:16
@jian-he
YARN-2308. Changed CapacityScheduler to explicitly throw exception if…
29496c9 
… the queue

to which the apps were submitted is changed across RM restart. Contributed by Craig Welch & Chang Li
(cherry picked from commit f9680d9)
@jian-he
Missing Changes.txt for YARN-2308
da3e84b 
(cherry picked from commit 178bc50)
@kambatla
YARN-2566. DefaultContainerExecutor should pick a working directory r…
e6102b1 
…andomly. (Zhihai Xu via kasha)

(cherry picked from commit cc93e7e)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DefaultContainerExecutor.java
@atm
HADOOP-11176. KMSClientProvider authentication fails when both curren…
834533f 
…tUgi and loginUgi are a proxied user. Contributed by Arun Suresh.

(cherry picked from commit 0e57aa3)
(cherry picked from commit f3132ee)
HDFS-7237. The command "hdfs namenode -rollingUpgrade" throws ArrayIn…
20fc34e 
…dexOutOfBoundsException.
HADOOP-11198. Fix typo in javadoc for FileSystem#listStatus(). Contri…
21fa0f6 
…buted by Li Lu.
@Jing9
HDFS-7228. Add an SSD policy into the default BlockStoragePolicySuite…
3d2d501 
…. Contributed by Jing Zhao.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockStoragePolicySuite.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestBlockStoragePolicy.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestStorageMover.java
@zjshen14
HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handl…
e71fa82 
…e all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen.

(cherry picked from commit cdce883)
@zjshen14
YARN-2656. Made RM web services authentication filter support proxy u…
eb055ea 
…ser. Contributed by Varun Vasudev and Zhijie Shen.

(cherry picked from commit 1220bb7)
@jlowe
MAPREDUCE-5873. Shuffle bandwidth computation includes time spent wai…
9203ea7 
…ting for maps. Contributed by Siqi Li

(cherry picked from commit b9edad6)
@Jing9
HDFS-7185. The active NameNode will not accept an fsimage sent from t…
439560d 
…he standby during rolling upgrade. Contributed by Jing Zhao.
@jlowe
MAPREDUCE-5970. Provide a boolean switch to enable MR-AM profiling. C…
ec38eec 
…ontributed by Gera Shegalov

(cherry picked from commit f19771a)
@jian-he
YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce…
bd45dba 
… to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA

(cherry picked from commit f93d2ea)
@raviprak
HADOOP-11181. GraphiteSink emits wrong timestamps (Sascha Coenen via …
7b53ab7 
…raviprak)

(cherry picked from commit 466f087)
@vinoduec
YARN-2496. Enhanced Capacity Scheduler to have basic support for allo…
fe80fd5 
…cating resources based on node-labels. Contributed by Wangda Tan.

YARN-2500. Ehnaced ResourceManager to support schedulers allocating resources based on node-labels. Contributed by Wangda Tan.

(cherry picked from commit f2ea555)
@vinoduec
YARN-2685. Fixed a bug in CommonNodeLabelsManager that caused wrong r…
8a09fdc 
…esource tracking per label when a host runs multiple node-managers. Contributed by Wangda Tan.

(cherry picked from commit b3056c2)
HDFS-7208. NN doesn't schedule replication when a DN storage fails. C…
253e3eb 
…ontributed by Ming Ma

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeDescriptor.java
HDFS-5089. When a LayoutVersion support SNAPSHOT, it must support FSI…
fd03689 
…MAGE_NAME_OPTIMIZATION.
@steveloughran
YARN-2689 TestSecureRMRegistryOperations failing on windows: secure Z…
b0a72f3 
…K won't start
@jian-he
YARN-2621. Simplify the output when the user doesn't have the access …
6be8330 
…for getDomain(s). Contributed by Zhijie Shen

(cherry picked from commit 233d446)
@raviprak-altiscale
HADOOP-11182. GraphiteSink emits wrong timestamps (Sascha Coenen via …
d4606bf 
…raviprak) Fix CHANGES.txt
@vinoduec
YARN-2699. Fixed a bug in CommonNodeLabelsManager that caused tests t…
778fbcd 
…o fail when using ephemeral ports on NodeIDs. Contributed by Wangda Tan.

(cherry picked from commit abae63c)
@jian-he
YARN-2588. Standby RM fails to transitionToActive if previous transit…
b7504f0 
…ionToActive failed with ZK exception. Contributed by Rohith Sharmaks

(cherry picked from commit a6aa6e4)
@jlowe
MAPREDUCE-5542. Killing a job just as it finishes can generate an NPE…
8217665 
… in client. Contributed by Rohith

(cherry picked from commit 209b169)
@vinoduec
HADOOP-11207. Enhanced common DelegationTokenAuthenticationHandler to…
db2bfed 
… support proxy-users on Delegation-token management operations. Contributed by Zhijie Shen.

(cherry picked from commit 1137557)
@arp7
HDFS-6924. Add new RAM_DISK storage type. (Arpit Agarwal)
d09f316 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/StorageType.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/hdfs.proto
@arp7
HDFS-6922. Add LazyPersist flag to INodeFile, save it in FsImage and …
1d9d29a 
…edit logs. (Arpit Agarwal)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatPBINode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageSerialization.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFileAttributes.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/FSImageFormatPBSnapshot.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/fsimage.proto
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/CreateEditsLog.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestEditLog.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSPermissionChecker.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java
@arp7
HDFS-6923. Propagate LazyPersist flag to DNs via DataTransferProtocol…
8c3c0ec 
…. (Arpit Agarwal)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/datatransfer/Receiver.java
@arp7
HDFS-6925. DataNode should attempt to place replicas on transient sto…
34d0088 
…rage first if lazyPersist flag is received. (Arpit Agarwal)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDirectoryScanner.java
@arp7
HDFS-6926. DN support for saving replicas to persistent storage and e…
8e01a89 
…victing in-memory replicas. (Arpit Agarwal)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
acmurthy and others added 25 commits November 9, 2014 19:16
@acmurthy
Release Notes for hadoop-2.6.0.
0ac7424
@acmurthy
Preparing to release hadoop-2.6.0: Set version in branch-2.6 to 2.6.1…
60584c7 
…-SNAPSHOT.
@acmurthy
Preparing to release hadoop-2.6.0: Set version in branch-2.6.0 to 2.6.0.
fc70bb3
@kambatla
Set the release date for 2.5.2
90061f2 
(cherry picked from commit 68a0508)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 92de44c)
@jian-he @acmurthy
HADOOP-9576. Changed NetUtils#wrapException to throw EOFException ins…
3dad831 
…tead of wrapping it as IOException. Contributed by Steve Loughran

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
@acmurthy
HADOOP-9576. Merging to branch-2.6 for hadoop-2.6.0-rc1.
fcd3067 
Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
@raviprak @raviprak-altiscale
YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN
28702a9
@xgong @acmurthy
YARN-2841. RMProxy should retry EOFException. Contributed by Jian He
2261e67
@vinoduec @acmurthy
YARN-2843. Fixed NodeLabelsManager to trim inputs for hosts and label…
601aba7 
…s so as to make them work correctly. Contributed by Wangda Tan.

(cherry picked from commit 0fd97f9)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
@acmurthy
YARN-2843. Merging to branch-2.6 for hadoop-2.6.0-rc1.
9d1bc9b 
(cherry picked from commit 51957ca)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
@zjshen14
YARN-2794. Fixed log messages about distributing system-credentials. …
5278cff 
…Contributed by Jian He.

(cherry picked from commit be7bf95)
@cnauroth
HDFS-7387. NFS may only do partial commit due to a race between COMMI…
1498dcc 
…T and write. Contributed by Brandon Li

(cherry picked from commit 99d9d0c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java

(cherry picked from commit 0c3b788)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit d0ca88c)
@acmurthy @cnauroth
HDFS-7387. Merging to branch-2.6 for hadoop-2.6.0-rc1.
5847583 
(cherry picked from commit 09f36b1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 42849e5)
@kambatla
HADOOP-11217. (Addendum to allow SSLv2Hello) Disable SSLv3 in KMS. (R…
4cd37ff 
…obert Kanter via kasha)

(cherry picked from commit 87818ef)
@acmurthy
HDFS-7391. Renable SSLv2Hello in HttpFS. Contributed by Robert Kanter.
d530460 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
Fix CHANGES.txt to keep it consistent with trunk.
a672d75
@kambatla @acmurthy
YARN-2635. TestRM, TestRMRestart, TestClientToAMTokens should run wit…
33031c9 
…h both CS and FS. (Wei Yan and kasha via kasha)

(cherry picked from commit 80d11eb)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestClientToAMTokens.java
@acmurthy
YARN-2635. Merging to branch-2.6 for hadoop-2.6.0-rc1.
86722bd 
(cherry picked from commit 81dc0ac)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
@vinoduec @acmurthy
YARN-2853. Fixed a bug in ResourceManager causing apps to hang when t…
bf4d080 
…he user kill request races with ApplicationMaster finish. Contributed by Jian He.

(cherry picked from commit 3651fe1)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
@jlowe @acmurthy
YARN-2846. Incorrect persist exit code for running containers in reac…
9820c47 
…quireContainer() that interrupted by NodeManager restart. Contributed by Junping Du

(cherry picked from commit 33ea5ae)
@acmurthy
YARN-2853. Merging to branch-2.6 for hadoop-2.6.0-rc1.
a97e9c0 
(cherry picked from commit d648e60)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
@jlowe @acmurthy
MAPREDUCE-6156. Fetcher - connect() doesn't handle connection refused…
9e8d1d7 
… correctly. Contributed by Junping Du

(cherry picked from commit 177e809)
@acmurthy
YARN-1964. Adding changelog back in.
2254e81 
(cherry picked from commit 4e9b46d)
@cnauroth
HDFS-7385. ThreadLocal used in FSEditLog class causes FSImage permiss…
8bcff27 
…ion mess up. Contributed by jiangyu.

(cherry picked from commit b0a41de)
(cherry picked from commit 4e90015)
(cherry picked from commit ed2a4db)
@acmurthy
Preparing to release hadoop-2.6.0-rc1.
e349649 
(cherry picked from commit 9ff7315)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 98a4538)
@omkarksa omkarksa closed this Dec 8, 2015
mekasone pushed a commit to mekasone/hadoop that referenced this pull request Feb 19, 2017
@ssk2
Merge pull request apache#25 from mesosphere/quote-username-and-password
e7c6d67 
Quote username and password
shanthoosh pushed a commit to shanthoosh/hadoop that referenced this pull request Oct 15, 2019
@prateekm @nickpan47
SAMZA-1054: Refactor Operator APIs
0054380 
Some suggestions for an Operator API refactor and misc. cleanup. It does contain some implementation changes, mostly due to deleted, extracted or merged classes. (e.g. OperatorFactory + ChainedOperators == OperatorImpls).

Since git marked several moved classes as (delete + new) instead, it's probably best to apply the diff locally and  browse the code in an IDE.

Some of the changes, in no particular order:
* Extracted XFunction interfaces into a .functions package in -api.
* -api's internal.Operators is now the -operators's spec.* package. Extracted interfaces and classes. Factory methods are now in OperatorSpecs.
* -api's MessageStreams is now -api's MessageStream interface and -operators's MessageStreamImpl.
* -api's internal.Windows classes are now in -api's .window package. Extracted interfaces and classes, but no implementation changes.
* OperatorFactory + ChainedOperators is now OperatorImpls, which is used from StreamOperatorAdaptorTask.
* Added a NoOpOperatorImpl, which acts as the root node for the OperatorImpl DAG returned by OperatorImpls.
* Removed usages of reactivestreams APIs since current code looks simpler without them. We can add them back when we need features like backpressure etc.
* Removed the InputSystemMessage interface.
* Made field names consistent (e.g Fn suffix for functions everywhere etc.).
* Some method/class visibility changes due to moved classes.
* General documentation changes, mostly to make public APIs clearer.

There are additional questions/tasks that we can address in future RBs:
* Updating Window and Trigger APIs.
* Merging samza-operator into samza-core.
* Questions about Message timestamp and Offset comparison semantics.
* Questions about OperatorSpec serialization (e.g. ID generation).
* Questions about StateStoreImpl and StoreFunctions.

Author: Prateek Maheshwari <[email protected]>

Reviewers: Yi Pan <[email protected]>, Jagadish <[email protected]>

Closes apache#25 from prateekm/master
passaro pushed a commit to passaro/hadoop that referenced this pull request Nov 23, 2022
@ahmarsuhail
More cleanup. (apache#25)
b73aca1 
removes unused imports and deprecation warnings.
saxenapranav pushed a commit to saxenapranav/hadoop that referenced this pull request Apr 27, 2023
@anmolanmol1234
Merge pull request apache#25 from ABFSDriver/configForFallback
1560285 
Config for fallback to DFS
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.