[SPARK-6074] [sql] Package pyspark sql bindings.

[vanzin]

This is needed for the SQL bindings to work on Yarn.

[vanzin]

$ jar tf sql/core/target/spark-sql_2.10-1.3.0-SNAPSHOT.jar | grep pyspark
pyspark/
pyspark/sql/
pyspark/sql/functions.py
pyspark/sql/__init__.py
pyspark/sql/tests.py
pyspark/sql/types.py
pyspark/sql/dataframe.py
pyspark/sql/context.py

[SparkQA]

Test build #28106 has started for PR 4822 at commit fb52001.

• This patch merges cleanly.

[srowen]

That seems like the right way to do this thing. It mirrors similar declarations for core, mllib, streaming, etc. Should tests.py be in here? Maybe not worth bothering since other declarations don't exclude test .py files.

[SparkQA]

Test build #28106 has finished for PR 4822 at commit fb52001.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28106/
Test PASSed.

[srowen]

I'd like to merge this in the next day or two as I think I agree that this could be a blocker. I think it's straightforward but invite a third set of eyes to take a look.

[pwendell]

Good catch @vanzin. This LGTM. I did some testing to verify that the assembly includes all relevant python files now:

$ jar -tf assembly/target/scala-2.10/spark-assembly-1.3.0-SNAPSHOT-hadoop1.0.4.jar  |grep \\.py$ |grep pyspark  | wc
      62      62    1480
$ find ./python/pyspark/ | grep \\.py$ | wc
      62      62    2100