Skip to content

yichen/spark-playground

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Spark Playground

This vagrant box will install a single-instance Apache Spark 2.0.0, on Ubuntu 14.04, with JDK 8.

To start the vagrant box, simply install Vagrant and VirtualBox, then run this command:

vagrant up

This will set up a virtual machine with the following configurations:

  • Ubuntu 14.04
  • Apache Spark 2.0.0
  • JDK 8
  • All spark ports are mapped to local ports on host machine

The Spark is installed under path /spark

Start Spark

  • Login to the virtual machine:
vagrant ssh
  • Start Spark cluster
/spark/sbin/start-all.sh

You may need to enter the user password for "vagrant", which is default to "vagrant".

  • Verify Spark is started and healthy Go to local browser and browse to http://localhost:8081. The Spark web UI should show up.

About

Quick Vagrantbox for experimenting with Spark 2.0

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •