-
Couldn't load subscription status.
- Fork 9.1k
HADOOP-19309: S3A CopyFromLocalFile operation fails when the source file does not contain file scheme #7113
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…ile does not contain file scheme
|
🎊 +1 overall
This message was automatically generated. |
|
@steveloughran - Could you please review the changes (small). |
|
@shameersss1 |
|
@steveloughran - Now that Hadoop 3.4.1 is released, Gentle reminder for review |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1
…file does not contain file scheme (#7113) Contributed by Syed Shameerur Rahman
Description of PR
When the sourcePath does not contain any file scheme information, S3A CopyFromLocalFile operation fails. Additionally the failure is seen only when the config
fs.s3a.optimized.copy.from.local.enabledis enabled (which is by default). This happens only when the local source file is given without any file scheme for example :/tmp/file.txtinstead offile:///tmp/file.txt.How was this patch tested?
Added a test case to validate the issue and the fix. Ran the test
ITestS3ACopyFromLocalFilein us-east-1For code changes:
LICENSE,LICENSE-binary,NOTICE-binaryfiles?