-
Notifications
You must be signed in to change notification settings - Fork 28.9k
[SPARK-19094][WIP][PySpark] Plumb through logging for IJupyter notebooks #17298
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-19094][WIP][PySpark] Plumb through logging for IJupyter notebooks #17298
Conversation
…tdout and launching an instance of spark and verifying we got the log info (TODO)
… overriden stdout
…e.g. testing) and leave things like doctest mode alone [otherwise we'd have to rewrite all of the doctests]
…y started, but we can verify it if we are launched without PYSAPRK_GATEWAY_PORT set
|
Test build #74568 has finished for PR 17298 at commit
|
|
jenkins retest this please. |
|
Test build #75869 has finished for PR 17298 at commit
|
|
Test build #75881 has finished for PR 17298 at commit
|
|
Test build #75882 has finished for PR 17298 at commit
|
|
Test build #76530 has finished for PR 17298 at commit
|
|
Test build #76711 has finished for PR 17298 at commit
|
|
Test build #76865 has finished for PR 17298 at commit
|
|
Test build #76870 has finished for PR 17298 at commit
|
|
Test build #76897 has finished for PR 17298 at commit
|
…uring standalone tests after reseting the stderr pipe so the user can see it
|
Test build #76903 has finished for PR 17298 at commit
|
|
Test build #77118 has finished for PR 17298 at commit
|
|
Test build #77120 has finished for PR 17298 at commit
|
|
Test build #77122 has finished for PR 17298 at commit
|
|
Test build #77127 has finished for PR 17298 at commit
|
|
Test build #77151 has finished for PR 17298 at commit
|
|
Jenkins retest this please. |
|
Test build #82050 has finished for PR 17298 at commit
|
…redirect the output
|
Test build #86233 has finished for PR 17298 at commit
|
|
Test build #86238 has finished for PR 17298 at commit
|
|
Eh we don't seem to need this anymore we plumb through the exception messages in another way. it's missing the logs but it's probably not worth it. Closing. |
What changes were proposed in this pull request?
Plumb through logging from the JVM into Jupyter notebooks to make debugging easier. This is a WIP PR
How was this patch tested?
Modified standalone_tests to allow testing with Python launch first in addition to the JVM launch first default.