Skip to content

Conversation

@sarutak
Copy link
Member

@sarutak sarutak commented Dec 7, 2016

What changes were proposed in this pull request?

When SSL is enabled, the Spark shell shows:

Spark context Web UI available at https://192.168.99.1:4040

This is wrong because 4040 is http, not https. It redirects to the https port.
More importantly, this introduces several broken links in the UI. For example, in the master UI, the worker link is https:8081 instead of http:8081 or https:8481.

CC: @mengxr @liancheng

I manually tested accessing by accessing MasterPage, WorkerPage and HistoryServer with SSL enabled.

@sarutak sarutak changed the title [SPARK-18761][WEBUI] Web UI should be http:4040 instead of https:4040 [SPARK-18761][WEBUI][WIP] Web UI should be http:4040 instead of https:4040 Dec 7, 2016
@SparkQA
Copy link

SparkQA commented Dec 7, 2016

Test build #69781 has started for PR 16190 at commit 4518010.

@viirya
Copy link
Member

viirya commented Dec 7, 2016

I think the jira number should be SPARK-18762, instead of SPARK-18761.

@sarutak sarutak changed the title [SPARK-18761][WEBUI][WIP] Web UI should be http:4040 instead of https:4040 [SPARK-18762][WEBUI][WIP] Web UI should be http:4040 instead of https:4040 Dec 7, 2016
@sarutak
Copy link
Member Author

sarutak commented Dec 7, 2016

@viirya Thanks! I've fixed it.

@sarutak
Copy link
Member Author

sarutak commented Dec 7, 2016

I've confirmed I can access MasterPage and WorkerPage with SSL enabled.
ssl0
ssl1

During the investigation, I've noticed one link from MasterPage to WorkerPage was broken before #15611. Maybe, 43f1d59 broke. I've also fixed it.

@sarutak
Copy link
Member Author

sarutak commented Dec 7, 2016

cc: @mengxr

@sarutak
Copy link
Member Author

sarutak commented Dec 7, 2016

Of course, HistoryServer works with SSL enabled.

ssl2

@sarutak sarutak changed the title [SPARK-18762][WEBUI][WIP] Web UI should be http:4040 instead of https:4040 [SPARK-18762][WEBUI] Web UI should be http:4040 instead of https:4040 Dec 7, 2016
@sarutak
Copy link
Member Author

sarutak commented Dec 7, 2016

Also, Spark Shell says as follows.

Spark context Web UI available at http://192.168.1.1:4040

@SparkQA
Copy link

SparkQA commented Dec 7, 2016

Test build #69790 has finished for PR 16190 at commit 66e0edf.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@mengxr
Copy link
Contributor

mengxr commented Dec 7, 2016

@sarutak Do you know why we needed this change to fix ssl-enabled history server in #15611?

@vanzin
Copy link
Contributor

vanzin commented Dec 7, 2016

@mengxr that change is actually incorrect and shouldn't have been merged. (The test changes in the same patch are ok though.)

This one LGTM.

@vanzin
Copy link
Contributor

vanzin commented Dec 7, 2016

merging to master / 2.1

@vanzin
Copy link
Contributor

vanzin commented Dec 7, 2016

Hmm, looks like the original change is in branch-2.0 also, let me try to merge there too.

@asfgit asfgit closed this in bb94f61 Dec 7, 2016
asfgit pushed a commit that referenced this pull request Dec 7, 2016
## What changes were proposed in this pull request?

When SSL is enabled, the Spark shell shows:
```
Spark context Web UI available at https://192.168.99.1:4040
```
This is wrong because 4040 is http, not https. It redirects to the https port.
More importantly, this introduces several broken links in the UI. For example, in the master UI, the worker link is https:8081 instead of http:8081 or https:8481.

CC: mengxr liancheng

I manually tested accessing by accessing MasterPage, WorkerPage and HistoryServer with SSL enabled.

Author: sarutak <[email protected]>

Closes #16190 from sarutak/SPARK-18761.

(cherry picked from commit bb94f61)
Signed-off-by: Marcelo Vanzin <[email protected]>
@vanzin
Copy link
Contributor

vanzin commented Dec 7, 2016

Merged to 2.0 also.

asfgit pushed a commit that referenced this pull request Dec 7, 2016
## What changes were proposed in this pull request?

When SSL is enabled, the Spark shell shows:
```
Spark context Web UI available at https://192.168.99.1:4040
```
This is wrong because 4040 is http, not https. It redirects to the https port.
More importantly, this introduces several broken links in the UI. For example, in the master UI, the worker link is https:8081 instead of http:8081 or https:8481.

CC: mengxr liancheng

I manually tested accessing by accessing MasterPage, WorkerPage and HistoryServer with SSL enabled.

Author: sarutak <[email protected]>

Closes #16190 from sarutak/SPARK-18761.

(cherry picked from commit bb94f61)
Signed-off-by: Marcelo Vanzin <[email protected]>
@mengxr
Copy link
Contributor

mengxr commented Dec 7, 2016

@sarutak Thanks for the quick fix!

robert3005 pushed a commit to palantir/spark that referenced this pull request Dec 15, 2016
## What changes were proposed in this pull request?

When SSL is enabled, the Spark shell shows:
```
Spark context Web UI available at https://192.168.99.1:4040
```
This is wrong because 4040 is http, not https. It redirects to the https port.
More importantly, this introduces several broken links in the UI. For example, in the master UI, the worker link is https:8081 instead of http:8081 or https:8481.

CC: mengxr liancheng

I manually tested accessing by accessing MasterPage, WorkerPage and HistoryServer with SSL enabled.

Author: sarutak <[email protected]>

Closes apache#16190 from sarutak/SPARK-18761.
uzadude pushed a commit to uzadude/spark that referenced this pull request Jan 27, 2017
## What changes were proposed in this pull request?

When SSL is enabled, the Spark shell shows:
```
Spark context Web UI available at https://192.168.99.1:4040
```
This is wrong because 4040 is http, not https. It redirects to the https port.
More importantly, this introduces several broken links in the UI. For example, in the master UI, the worker link is https:8081 instead of http:8081 or https:8481.

CC: mengxr liancheng

I manually tested accessing by accessing MasterPage, WorkerPage and HistoryServer with SSL enabled.

Author: sarutak <[email protected]>

Closes apache#16190 from sarutak/SPARK-18761.
@sarutak sarutak deleted the SPARK-18761 branch June 4, 2021 20:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants