[SPARK-29053][WEBUI] Sort does not work on some columns

[amanomer]

What changes were proposed in this pull request?

Setting custom sort key for duration and execution time column.

Why are the changes needed?

Sorting on duration and execution time columns consider time as a string after converting into readable form which is the reason for wrong sort results as mentioned in SPARK-29053.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Test manually. Screenshots are attached.

After patch:
Duration

Execution time

[wangyum]

ok to test

[SparkQA]

Test build #111011 has finished for PR 25855 at commit f36a618.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[amanomer]

cc @srowen @gatorsmile

[srowen]

Looks good, but do other pages have a similar problem too? I would not be surprised.

[amanomer]

No, I haven't found this issue anywhere else.

[amanomer]

thanks @srowen

[SparkQA]

Test build #4879 has finished for PR 25855 at commit f36a618.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[dongjoon-hyun]

Hi, @amanomer . Thank you for your contribution. I'd like to recommend the followings first.

1. Please attach your PR's screenshot. The current one is your internal one as you see the Spark version 2.3.2.020x.
2. While you are here, could you fix the Execution Time which is the very left column to this? Execution Time has the same issue. If you build your PR branch, you can see that column.
   • Please see line 74.

After fixing the above two, you need to update the PR title and description and JIRA accordingly, too. Thanks!

[amanomer]

@dongjoon-hyun thanks for your feedback.
I am working on this.

[dongjoon-hyun]

Thanks, @amanomer . I'll review again after you update this PR.

[srowen]

Looks good pending tests.

[SparkQA]

Test build #111079 has finished for PR 25855 at commit d17c7b6.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[srowen]

Merged to master. It didn't pick cleanly into 2.4. If we need it there, open another PR with the back-port.

[amanomer]

Thanks @srowen .
I will open another PR to back-port this commit in 2.4.

[dongjoon-hyun]

Thank you, @amanomer and @srowen !