-
Notifications
You must be signed in to change notification settings - Fork 28.9k
[SPARK-28599][SQL][2.4] Fix Duration column sorting for ThriftServerSessionPage
#25906
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
… for ThriftServerSessionPage This PR add support sorting `Execution Time` and `Duration` columns for `ThriftServerSessionPage`. Previously, it's not sorted correctly. Yes. Manually do the following and test sorting on those columns in the Spark Thrift Server Session Page. ``` $ sbin/start-thriftserver.sh $ bin/beeline -u jdbc:hive2://localhost:10000 0: jdbc:hive2://localhost:10000> create table t(a int); +---------+--+ | Result | +---------+--+ +---------+--+ No rows selected (0.521 seconds) 0: jdbc:hive2://localhost:10000> select * from t; +----+--+ | a | +----+--+ +----+--+ No rows selected (0.772 seconds) 0: jdbc:hive2://localhost:10000> show databases; +---------------+--+ | databaseName | +---------------+--+ | default | +---------------+--+ 1 row selected (0.249 seconds) ``` **Sorted by `Execution Time` column**:  **Sorted by `Duration` column**:  Closes apache#25892 from wangyum/SPARK-28599. Authored-by: Yuming Wang <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks OK pending tests as a back-port.
|
Test build #4882 has finished for PR 25906 at commit
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you, @amanomer . This backporting is correctly made by using @wangyum 's authorship.
I fixed the followings because this PR still ignored my advice on the original PR.
- I fixed the title because this PR doesn't fix
Execution Timecolumn because it doesn't exist. - I fixed the PR description with the same reason, also removed the first image
Sorted by Execution Time column:
The renaming image is technically wrong because it's a screenshot of 3.0.0-SNAPSHOT. We had better replace it with 2.4.5-SNAPSHOT. However, it's understandable.
Execution Time and Duration column sorting for ThriftServerSessionPageDuration column sorting for ThriftServerSessionPage
…rSessionPage ### What changes were proposed in this pull request? This PR add support sorting `Duration` columns for `ThriftServerSessionPage`. ### Why are the changes needed? Previously, it's not sorted correctly. ### Does this PR introduce any user-facing change? Yes. ### How was this patch tested? Manually do the following and test sorting on those columns in the Spark Thrift Server Session Page. ``` $ sbin/start-thriftserver.sh $ bin/beeline -u jdbc:hive2://localhost:10000 0: jdbc:hive2://localhost:10000> create table t(a int); +---------+--+ | Result | +---------+--+ +---------+--+ No rows selected (0.521 seconds) 0: jdbc:hive2://localhost:10000> select * from t; +----+--+ | a | +----+--+ +----+--+ No rows selected (0.772 seconds) 0: jdbc:hive2://localhost:10000> show databases; +---------------+--+ | databaseName | +---------------+--+ | default | +---------------+--+ 1 row selected (0.249 seconds) ``` **Sorted by `Duration` column**:  Closes #25906 from amanomer/BP_28599. Authored-by: Yuming Wang <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
|
Thank you all. |
What changes were proposed in this pull request?
This PR add support sorting
Durationcolumns forThriftServerSessionPage.Why are the changes needed?
Previously, it's not sorted correctly.
Does this PR introduce any user-facing change?
Yes.
How was this patch tested?
Manually do the following and test sorting on those columns in the Spark Thrift Server Session Page.
Sorted by

Durationcolumn: