Spark 1490 Add kerberos support to the HistoryServer #513
Conversation
|
Merged build triggered. |
|
Merged build started. |
|
Merged build finished. |
|
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14389/ |
|
test failure is unrelated. |
|
Jenkins, test this please |
|
Merged build triggered. |
|
Merged build started. |
|
Merged build finished. All automated tests passed. |
|
All automated tests passed. |
There was a problem hiding this comment.
could this be spark.history.kerberos.enabled to be more consistent with the other on/off options.
|
Looks good to me pending a small config name suggestion - @tgravescs if you are okay with the suggestion I can just merge this and make the small change. Let me know. |
|
Thats fine with me. Don't forget to update docs with name change. Thanks @pwendell ! |
|
Great thinks - I think I've gotten all of the cases covered. |
Here I've added the ability for the History server to login from a kerberos keytab file so that the history server can be run as a super user and stay up for along period of time while reading the history files from HDFS. Author: Thomas Graves <[email protected]> Closes #513 from tgravescs/SPARK-1490 and squashes the following commits: e204a99 [Thomas Graves] remove extra logging 5418daa [Thomas Graves] fix typo in config 0076b99 [Thomas Graves] Update docs 4d76545 [Thomas Graves] SPARK-1490 Add kerberos support to the HistoryServer (cherry picked from commit bd37509) Signed-off-by: Patrick Wendell <[email protected]>
Here I've added the ability for the History server to login from a kerberos keytab file so that the history server can be run as a super user and stay up for along period of time while reading the history files from HDFS. Author: Thomas Graves <[email protected]> Closes apache#513 from tgravescs/SPARK-1490 and squashes the following commits: e204a99 [Thomas Graves] remove extra logging 5418daa [Thomas Graves] fix typo in config 0076b99 [Thomas Graves] Update docs 4d76545 [Thomas Graves] SPARK-1490 Add kerberos support to the HistoryServer
"cloud-provider-openstack-acceptance-test-keystone-authentication-authorization" failing since latest commit in k8s repo. This commit is to fix the same. Close : theopenlab/openlab#253
… lazy (apache#513) Co-authored-by: mingmwang <[email protected]> Co-authored-by: Wang <[email protected]>
4 participants
Here I've added the ability for the History server to login from a kerberos keytab file so that the history server can be run as a super user and stay up for along period of time while reading the history files from HDFS.