Skip to content

Conversation

@vanzin
Copy link
Contributor

@vanzin vanzin commented Feb 20, 2018

This is much faster than finding out what the last attempt is, and the
data should be the same.

There's room for improvement in this page (like only loading data for
the jobs being shown, instead of loading all available jobs and sorting
them), but this should bring performance on par with the 2.2 version.

…iption.

This is much faster than finding out what the last attempt is, and the
data should be the same.

There's room for improvement in this page (like only loading data for
the jobs being shown, instead of loading all available jobs and sorting
them), but this should bring performance on par with the 2.2 version.
@vanzin
Copy link
Contributor Author

vanzin commented Feb 20, 2018

Tested by running:

(1 to 999).foreach { i =>
   sc.parallelize(0 to i, i).count()
}

UI is not blazing fast, but usable.

@vanzin
Copy link
Contributor Author

vanzin commented Feb 20, 2018

@zsxwing

@zsxwing
Copy link
Member

zsxwing commented Feb 21, 2018

Thanks for fixing this so fast. I'm testing it now.

@zsxwing
Copy link
Member

zsxwing commented Feb 21, 2018

Verified that this patch fixes the issue. LGTM

@SparkQA
Copy link

SparkQA commented Feb 21, 2018

Test build #87568 has finished for PR 20644 at commit 0dc95ad.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@sameeragarwal
Copy link
Member

merging this to master/2.3. Thanks!

asfgit pushed a commit that referenced this pull request Feb 21, 2018
…iption.

This is much faster than finding out what the last attempt is, and the
data should be the same.

There's room for improvement in this page (like only loading data for
the jobs being shown, instead of loading all available jobs and sorting
them), but this should bring performance on par with the 2.2 version.

Author: Marcelo Vanzin <[email protected]>

Closes #20644 from vanzin/SPARK-23470.

(cherry picked from commit 2ba77ed)
Signed-off-by: Sameer Agarwal <[email protected]>
@asfgit asfgit closed this in 2ba77ed Feb 21, 2018
@vanzin vanzin deleted the SPARK-23470 branch March 5, 2018 23:55
peter-toth pushed a commit to peter-toth/spark that referenced this pull request Oct 6, 2018
…iption.

This is much faster than finding out what the last attempt is, and the
data should be the same.

There's room for improvement in this page (like only loading data for
the jobs being shown, instead of loading all available jobs and sorting
them), but this should bring performance on par with the 2.2 version.

Author: Marcelo Vanzin <[email protected]>

Closes apache#20644 from vanzin/SPARK-23470.

(cherry picked from commit 2ba77ed)
Signed-off-by: Sameer Agarwal <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants