Skip to content

Conversation

@mccormickt12
Copy link
Contributor

@mccormickt12 mccormickt12 commented Mar 1, 2023

…… (#5322)

HDFS-16896 clear ignoredNodes list when we clear deadnode list on refetchLocations. ignoredNodes list is only used on hedged read codepath

Description of PR

Backporting hedged read fixes to branch 3.3

How was this patch tested?

Added tests and tested by LinkedIn Trino to verify performance improvements
Ran TestPread and TestDFSInputStreamBlockLocations tests manually all passed.

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

apache#5322)

HDFS-16896 clear ignoredNodes list when we clear deadnode list on refetchLocations. 
ignoredNodes list is only used on hedged read codepath

Co-authored-by: Tom McCormick <[email protected]>
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ docker 5m 55s Docker failed to build run-specific yetus/hadoop:tp-9052}.
Subsystem Report/Notes
GITHUB PR #5444
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5444/1/console
versions git=2.17.1
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@omalley omalley merged commit 703158c into apache:branch-3.3 Mar 2, 2023
bbeaudreault pushed a commit to HubSpot/hadoop that referenced this pull request Jul 12, 2023
…adnode list on ref… (apache#5322) (apache#5444)

Cherry picked from: 162288b

Co-authored-by: Tom McCormick <[email protected]>
NyteKnight pushed a commit to NyteKnight/hadoop that referenced this pull request Jun 25, 2024
apache#5322) (apache#5444) (apache#99)

Cherry picked from: 162288b

Co-authored-by: Tom McCormick <[email protected]>

ACLOVERRIDE for oss email

Co-authored-by: Tom <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants