Skip to content
Closed
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,10 @@ In addition, if you wish to run Spark on [YARN](running-on-yarn.html), set

Note that on Windows, you need to set the environment variables on separate lines, e.g., `set SPARK_HADOOP_VERSION=1.2.1`.

If you want to access Amazon S3 with a Spark compiled with Hadoop 2.3.0 or newer version, you have to manually update the dependency of
jets3t to 0.9.0 in the Spark build file (pom.xml or project/SparkBuild.scala), as jets3t 0.9.0 is introduced in the latest
versions of Hadoop and not backward compatible.

# Where to Go from Here

**Programming guides:**
Expand Down