Skip to content

[SPSARK-8578] [SQL] Should ignore user defined output committer when appending data (branch 1.4) #6965

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 701 commits into from
Closed

[SPSARK-8578] [SQL] Should ignore user defined output committer when appending data (branch 1.4) #6965

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
701 commits
Select commit Hold shift + click to select a range
bd9173c
[SPARK-7907] [SQL] [UI] Rename tab ThriftServer to SQL.
yhuai May 28, 2015
9da4b6b
[SPARK-7873] Allow KryoSerializerInstance to create multiple streams …
JoshRosen May 28, 2015
d83c2ee
[SPARK-7896] Allow ChainedBuffer to store more than 2 GB
sryza May 28, 2015
4983dfc
Preparing Spark release v1.4.0-rc3
pwendell May 28, 2015
7c342bd
Preparing development version 1.4.0-SNAPSHOT
pwendell May 28, 2015
63be026
[DOCS] Fix typo in documentation for Java UDF registration
wisematthew May 28, 2015
bd568df
[SPARK-7782] fixed sort arrow issue
zuxqoj May 28, 2015
ab62d73
[SPARK-7895] [STREAMING] [EXAMPLES] Move Kafka examples from scala-2.…
zsxwing May 28, 2015
7b5dffb
[SPARK-7911] [MLLIB] A workaround for VectorUDT serialize (or deseria…
mengxr May 28, 2015
4485283
[MINOR] Fix the a minor bug in PageRank Example.
lastland May 28, 2015
0a65224
[DOCS] Fixing broken "IDE setup" link in the Building Spark documenta…
dusenberrymw May 28, 2015
b9bdf12
[SPARK-7198] [MLLIB] VectorAssembler should output ML attributes
mengxr May 28, 2015
9c2c6b4
Remove SizeEstimator from o.a.spark package.
rxin May 28, 2015
8f4a86e
[SPARK-7853] [SQL] Fix HiveContext in Spark Shell
yhuai May 29, 2015
7bb445a
[SPARK-7577] [ML] [DOC] add bucketizer doc
yinxusen May 29, 2015
f4b1353
[SPARK-7927] whitespace fixes for streaming.
rxin May 29, 2015
3b38c06
[SPARK-7927] whitespace fixes for Hive and ThriftServer.
rxin May 29, 2015
3479e6a
[SPARK-7933] Remove Patrick's username/pw from merge script
kayousterhout May 29, 2015
0c05115
[SPARK-7927] [MLLIB] Enforce whitespace for more tokens in style checker
mengxr May 29, 2015
9b97e95
[SPARK-7927] whitespace fixes for SQL core.
rxin May 29, 2015
142ae52
[SPARK-7929] Remove Bagel examples & whitespace fix for examples.
rxin May 29, 2015
22e42e3
[SPARK-7927] whitespace fixes for Catalyst module.
rxin May 29, 2015
e3dd280
[SPARK-7927] whitespace fixes for core.
rxin May 29, 2015
b3a5900
[SPARK-7927] whitespace fixes for GraphX.
rxin May 29, 2015
6e99dd5
[SPARK-7926] [PYSPARK] use the official Pyrolite release
mengxr May 29, 2015
1d49d8c
[MINOR] fix RegressionEvaluator doc
mengxr May 29, 2015
aee046d
[SPARK-7932] Fix misleading scheduler delay visualization
kayousterhout May 29, 2015
f7cb272
[SPARK-7930] [CORE] [STREAMING] Fixed shutdown hook priorities
tdas May 29, 2015
6855942
[SPARK-7922] [MLLIB] use DataFrames for user/item factors in ALSModel
mengxr May 29, 2015
7a52fdf
[SPARK-7931] [STREAMING] Do not restart receiver when stopped
tdas May 29, 2015
e419821
[HOTFIX] Minor style fix from last commit
pwendell May 29, 2015
2d97d7a
Preparing Spark release v1.4.0-rc3
pwendell May 29, 2015
119c93a
Preparing development version 1.4.0-SNAPSHOT
pwendell May 29, 2015
55dc7a6
[SPARK-7929] Turn whitespace checker on for more token types.
rxin May 29, 2015
f279681
Preparing Spark release v1.4.0-rc3
pwendell May 29, 2015
6bf5a42
Preparing development version 1.4.0-SNAPSHOT
pwendell May 29, 2015
509a7ca
[SPARK-7912] [SPARK-7921] [MLLIB] Update OneHotEncoder to handle ML a…
mengxr May 29, 2015
459c3d2
[SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IB…
tellison May 29, 2015
23bd05f
HOTFIX: Scala style checker failure due to a missing space in Tachyon…
rxin May 29, 2015
caea7a6
[SPARK-7950] [SQL] Sets spark.sql.hive.version in HiveThriftServer2.s…
liancheng May 29, 2015
62df047
HOTFIX: Scala style checker for DataTypeSuite.scala.
rxin May 29, 2015
645e611
[SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftS…
liancheng May 29, 2015
4be701a
[SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans
MechCoder May 29, 2015
fb60503
Preparing Spark release v1.4.0-rc3
pwendell May 29, 2015
c68abaa
Preparing development version 1.4.0-SNAPSHOT
pwendell May 29, 2015
18811ca
Revert "[SQL] [TEST] [MINOR] Uses a temporary log4j.properties in Hiv…
pwendell May 29, 2015
dd109a8
Preparing Spark release v1.4.0-rc3
pwendell May 29, 2015
e549874
Preparing development version 1.4.0-SNAPSHOT
pwendell May 29, 2015
f40605f
[SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY,…
rxin May 29, 2015
cf4122e
[SPARK-6806] [SPARKR] [DOCS] Add a new SparkR programming guide
shivaram May 29, 2015
2bd4460
[SPARK-7954] [SPARKR] Create SparkContext in sparkRSQL init
shivaram May 29, 2015
9a88be1
[SPARK-6013] [ML] Add more Python ML examples for spark.ml
May 29, 2015
400e6db
[DOCS][Tiny] Added a missing dash(-) in docs/configuration.md
mrt May 30, 2015
1513cff
[SPARK-7957] Preserve partitioning when using randomSplit
brkyvz May 30, 2015
11a4b30
[SPARK-7576] [MLLIB] Add spark.ml user guide doc/example for Elementw…
ogeagla May 30, 2015
8938a74
[SPARK-7962] [MESOS] Fix master url parsing in rest submission client.
tnachen May 30, 2015
2c45009
[SPARK-7459] [MLLIB] ElementwiseProduct Java example
ogeagla May 30, 2015
d6e9ead
[SPARK-7890] [DOCS] Document that Spark 2.11 now supports Kafka
srowen May 30, 2015
e7ba3ea
[DOCS] [MINOR] Update for the Hadoop versions table with hadoop-2.6
mrt May 30, 2015
b2b7601
[SPARK-7849] [SQL] [Docs] Updates SQL programming guide for 1.4
liancheng May 30, 2015
6d7cf53
Updated SQL programming guide's Hive connectivity section.
rxin May 30, 2015
2790bb0
[SPARK-7918] [MLLIB] MLlib Python doc parity check for evaluation and…
yanboliang May 30, 2015
df56309
[SPARK-7920] [MLLIB] Make MLlib ChiSqSelector Serializable (& Fix Rel…
dusenberrymw May 30, 2015
a60b8bf
[SPARK-5610] [DOC] update genjavadocSettings to use the patched versi…
mengxr May 31, 2015
dc58e68
[SQL] Tighten up visibility for JavaDoc.
rxin May 31, 2015
e74ea78
[SPARK-7971] Add JavaDoc style deprecation for deprecated DataFrame m…
rxin May 31, 2015
5e268d3
Update documentation for the new DataFrame reader/writer interface.
rxin May 31, 2015
adfc9d1
[SPARK-7976] Add style checker to disallow overriding finalize.
rxin May 31, 2015
0d093d6
[SQL] [MINOR] Adds @deprecated Scaladoc entry for SchemaRDD
liancheng May 31, 2015
2016927
[SPARK-7975] Add style checker to disallow overriding equals covarian…
rxin May 31, 2015
a7c2171
[SPARK-3850] Trim trailing spaces for core.
rxin May 31, 2015
f63eab9
[SPARK-3850] Trim trailing spaces for examples/streaming/yarn.
rxin May 31, 2015
a1904fa
[SPARK-3850] Trim trailing spaces for SQL.
rxin May 31, 2015
01f38f7
[SPARK-7979] Enforce structural type checker.
rxin May 31, 2015
8a72bc9
[MINOR] Add license for dagre-d3 and graphlib-dot
zsxwing May 31, 2015
70cf9c3
[SPARK-3850] Trim trailing spaces for MLlib.
rxin May 31, 2015
4d5ce46
[SPARK-7949] [MLLIB] [DOC] update document with some missing save/load
hhbyyh May 31, 2015
bab0fab
[SPARK-3850] Turn style checker on for trailing whitespaces.
rxin May 31, 2015
f1d4e7e
[SPARK-7227] [SPARKR] Support fillna / dropna in R DataFrame.
May 31, 2015
df0bf71
[HOTFIX] Remove trailing whitespace to fix Scalastyle checks
JoshRosen May 31, 2015
78a6723
[SPARK-7978] [SQL] [PYSPARK] DecimalType should not be singleton
Jun 1, 2015
2f41cf3
[DOC] Minor modification to Streaming docs with regards to parallel d…
nishkamravi2 Jun 1, 2015
d023300
[SPARK-7497] [PYSPARK] [STREAMING] fix streaming flaky tests
Jun 1, 2015
4cafc63
[SPARK-7584] [MLLIB] User guide for VectorAssembler
mengxr Jun 1, 2015
a76c2e1
[SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict
mnazbro May 29, 2015
a7c8b00
[SPARK-7958] [STREAMING] Handled exception in StreamingContext.start(…
tdas Jun 2, 2015
f5a9833
[MINOR] [UI] Improve error message on log page
Jun 2, 2015
cbfb682
[SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR
shivaram Jun 2, 2015
efc0e05
[SPARK-7982][SQL] DataFrame.stat.crosstab should use 0 instead of nul…
rxin Jun 2, 2015
8ac2376
[SPARK-8026][SQL] Add Column.alias to Scala/Java DataFrame API
rxin Jun 2, 2015
d542a35
[SPARK-8027] [SPARKR] Add maven profile to build R package docs
shivaram Jun 2, 2015
3af4c0b
[minor doc] Add exploratory data analysis warning for DataFrame.stat.…
rxin Jun 2, 2015
0d21a41
[SPARK-8025][Streaming]Add JavaDoc style deprecation for deprecated S…
zsxwing Jun 2, 2015
e6d5895
[SPARK-7965] [SPARK-7972] [SQL] Handle expressions containing multipl…
yhuai Jun 2, 2015
575f3b3
Fixed typo in the previous commit.
rxin Jun 2, 2015
011b07e
[SPARK-7582] [MLLIB] user guide for StringIndexer
mengxr Jun 2, 2015
9d6475b
[SPARK-6917] [SQL] DecimalType is not read back when non-native type …
Jun 2, 2015
4940630
[SPARK-8020] [SQL] Spark SQL conf in spark-defaults.conf make metadat…
yhuai Jun 2, 2015
87941ff
[SPARK-8023][SQL] Add "deterministic" attribute to Expression to avoi…
yhuai Jun 2, 2015
292ee1a
[SPARK-8021] [SQL] [PYSPARK] make Python read/write API consistent wi…
Jun 2, 2015
48c5067
Preparing Spark release v1.4.0-rc4
pwendell Jun 2, 2015
92a6778
Preparing development version 1.4.0-SNAPSHOT
pwendell Jun 2, 2015
97fedf1
[SPARK-7432] [MLLIB] fix flaky CrossValidator doctest
mengxr Jun 2, 2015
8c3fc3a
[HOT-FIX] Add EvaluatedType back to RDG
yhuai Jun 2, 2015
f71a09d
[SPARK-8037] [SQL] Ignores files whose name starts with dot in Hadoop…
liancheng Jun 2, 2015
fa292dc
[SPARK-8015] [FLUME] Remove Guava dependency from flume-sink.
Jun 2, 2015
139c824
[MINOR] Enable PySpark SQL readerwriter and window tests
JoshRosen May 31, 2015
815e056
[SPARK-7985] [ML] [MLlib] [Docs] Remove "fittingParamMap" references.…
dusenberrymw Jun 2, 2015
cbaf595
[SPARK-8014] [SQL] Avoid premature metadata discovery when writing a …
liancheng Jun 2, 2015
6b0f615
[SPARK-8038] [SQL] [PYSPARK] fix Column.when() and otherwise()
Jun 2, 2015
d630f4d
Preparing Spark release v1.4.0-rc4
pwendell Jun 2, 2015
92ccc5b
Preparing development version 1.4.0-SNAPSHOT
pwendell Jun 2, 2015
97d4cd0
[SPARK-8049] [MLLIB] drop tmp col from OneVsRest output
mengxr Jun 2, 2015
a14fad1
Preparing Spark release v1.4.0-rc4
pwendell Jun 3, 2015
e3c35b2
Preparing development version 1.4.0-SNAPSHOT
pwendell Jun 3, 2015
daeaa0c
[SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftS…
liancheng May 29, 2015
0d83720
[SQL] [TEST] [MINOR] Follow-up of PR #6493, use Guava API to ensure J…
liancheng Jun 3, 2015
22596c5
Preparing Spark release v1.4.0-rc4
pwendell Jun 3, 2015
ab713af
Preparing development version 1.4.0-SNAPSHOT
pwendell Jun 3, 2015
6a3e32a
[SPARK-7387] [ML] [DOC] CrossValidator example code in Python
Jun 3, 2015
6391be8
[SPARK-7547] [ML] Scala Example code for ElasticNet
Jun 3, 2015
88399c3
[SPARK-8053] [MLLIB] renamed scalingVector to scalingVec
jkbradley Jun 3, 2015
33edb2b
[SPARK-8043] [MLLIB] [DOC] update NaiveBayes and SVM examples in doc
hhbyyh Jun 3, 2015
bd57af3
[SPARK-8032] [PYSPARK] Make version checking for NumPy in MLlib more …
MechCoder Jun 3, 2015
ee7f365
[SPARK-8060] Improve DataFrame Python test coverage and documentation.
rxin Jun 3, 2015
54a4ea4
[SPARK-7973] [SQL] Increase the timeout of two CliSuite tests.
yhuai Jun 3, 2015
0a1dad6
[SPARK-7980] [SQL] Support SQLContext.range(end)
Jun 3, 2015
f67a27d
[SPARK-8063] [SPARKR] Spark master URL conflict between MASTER env va…
Jun 3, 2015
1f90a06
[SPARK-8074] Parquet should throw AnalysisException during setup for …
rxin Jun 3, 2015
bfab61f
[SPARK-8054] [MLLIB] Added several Java-friendly APIs + unit tests
jkbradley Jun 3, 2015
31e0ae9
[MINOR] [UI] Improve confusing message on log page
Jun 3, 2015
59399a8
[SPARK-8083] [MESOS] Use the correct base path in mesos driver page.
tnachen Jun 3, 2015
306837e
[SPARK-8001] [CORE] Make AsynchronousListenerBus.waitUntilEmpty throw…
zsxwing Jun 3, 2015
7e46ea0
[SPARK-7989] [CORE] [TESTS] Fix flaky tests in ExternalShuffleService…
zsxwing Jun 3, 2015
ca21fff
[SPARK-3674] [EC2] Clear SPARK_WORKER_INSTANCES when using YARN
shivaram Jun 3, 2015
b2a22a6
[SPARK-8051] [MLLIB] make StringIndexerModel silent if input column d…
mengxr Jun 3, 2015
d0be950
[HOTFIX] Unbreak build from backporting #6546
Jun 3, 2015
0bc9a3e
[HOTFIX] [TYPO] Fix typo in #6546
Jun 3, 2015
1674869
[SPARK-8088] don't attempt to lower number of executors by 0
ryan-williams Jun 3, 2015
c2c1290
[SPARK-8084] [SPARKR] Make SparkR scripts fail on error
shivaram Jun 4, 2015
96f71b1
[BUILD] Increase Jenkins test timeout
Jun 4, 2015
584a2ba
[BUILD] Use right branch when checking against Hive (1.4)
Jun 4, 2015
bfe74b3
[SPARK-7558] Demarcate tests in unit-tests.log (1.4)
Jun 4, 2015
84da653
[BUILD] Fix Maven build for Kinesis
Jun 4, 2015
daf9451
Fix maxTaskFailures comment
darabos Jun 4, 2015
81ff7a9
[SPARK-7969] [SQL] Added a DataFrame.drop function that accepts a Col…
dusenberrymw Jun 4, 2015
0b71b85
[SPARK-8027] [SPARKR] Move man pages creation to install-dev.sh
shivaram Jun 4, 2015
3ba6fc5
[SPARK-8098] [WEBUI] Show correct length of bytes on log page
carsonwang Jun 4, 2015
f02af7c
[SPARK-8116][PYSPARK] Allow sc.range() to take a single argument.
belisarius222 Jun 5, 2015
90cf686
[MINOR] remove unused interpolation var in log message
srowen Jun 5, 2015
9b3e4c1
[MINOR] [BUILD] Use custom temp directory during build.
Jun 5, 2015
0ef2e9d
[STREAMING] Update streaming-kafka-integration.md
Jun 5, 2015
3e3151e
[SPARK-8085] [SPARKR] Support user-specified schema in read.df
shivaram Jun 5, 2015
429c658
Revert "[MINOR] [BUILD] Use custom temp directory during build."
Jun 5, 2015
200c980
[SPARK-8112] [STREAMING] Fix the negative event count issue
zsxwing Jun 5, 2015
94f65bc
[SPARK-7747] [SQL] [DOCS] spark.sql.planner.externalSort
lucamartinetti Jun 5, 2015
84523fc
[SPARK-7991] [PySpark] Adding support for passing lists to describe.
Jun 5, 2015
d8a53fb
[SPARK-8079] [SQL] Makes InsertIntoHadoopFsRelation job/task abortion…
liancheng Jun 6, 2015
6faaf15
[SPARK-7955] [CORE] Ensure executors with cached RDD blocks are not re…
harishreedharan Jun 7, 2015
b6fdc6c
[SPARK-8004][SQL] Enclose column names by JDBC Dialect
viirya Jun 7, 2015
9d1f4d6
[SPARK-8145] [WEBUI] Trigger a double click on the span to show full …
Jun 7, 2015
b4d5441
[SPARK-8141] [SQL] Precompute datatypes for partition columns and reu…
viirya Jun 7, 2015
ff26767
[SPARK-8146] DataFrame Python API: Alias replace in df.na
rxin Jun 7, 2015
b9c046f
[SPARK-8004][SQL] Quote identifier in JDBC data source.
rxin Jun 7, 2015
58bfdd6
[SPARK-4761] [DOC] [SQL] kryo default setting in SQL Thrift server
adrian-wang Jun 8, 2015
a3afc2c
[SPARK-7705] [YARN] Cleanup of .sparkStaging directory fails if appli…
Sephiroth-Lin Jun 8, 2015
69197c3
[SPARK-8121] [SQL] Fixes InsertIntoHadoopFsRelation job initializatio…
liancheng Jun 8, 2015
99c2a57
[SPARK-8126] [BUILD] Use custom temp directory during build.
Jun 8, 2015
e9a8372
[SPARK-8162] [HOTFIX] Fix NPE in spark-shell
Jun 9, 2015
0a9383d
[SPARK-6820] [SPARKR] Convert NAs to null type in SparkR DataFrames
hqzizania Jun 9, 2015
a7b7a19
[SPARK-8274] [DOCUMENTATION-MLLIB] Fix wrong URLs in MLlib Frequent P…
FavioVazquez Jun 9, 2015
1175cfe
[MINOR] [UI] DAG visualization: trim whitespace from input
Jun 9, 2015
a0a7f2f
[SPARK-6511] [DOCUMENTATION] Explain how to use Hadoop provided builds
pwendell Jun 9, 2015
7b88e6a
[SQL] [MINOR] Fixes a minor Java example error in SQL programming guide
liancheng Jun 10, 2015
28e8a6e
[SPARK-8282] [SPARKR] Make number of threads used in RBackend configu…
falaki Jun 10, 2015
568d1d5
[SPARK-7756] CORE RDDOperationScope fix for IBM Java
a-roberts Jun 10, 2015
2846a35
[SPARK-8273] Driver hangs up when yarn shutdown in client mode
WangTaoTheTonic Jun 10, 2015
59fc3f1
[SPARK-8200] [MLLIB] Check for empty RDDs in StreamingLinearAlgorithm
pparkkin Jun 10, 2015
5c05b5c
[SPARK-8285] [SQL] CombineSum should be calculated as unlimited decim…
navis Jun 11, 2015
b313920
[SPARK-8289] Specify stack size for consistency with Java tests - res…
a-roberts Jun 11, 2015
3a62569
[SPARK-8310] [EC2] Update spark-ec2 branch to 1.4
shivaram Jun 11, 2015
8b25f62
[SPARK-6511] [docs] Fix example command in hadoop-provided docs.
Jun 11, 2015
141eab7
[SPARK-8322] [EC2] Added spark 1.4.0 into the VALID_SPARK_VERSIONS and…
Jun 12, 2015
7608373
[SPARK-8330] DAG visualization: trim whitespace from input
Jun 12, 2015
7c11ccf
[SPARK-7284] [STREAMING] Updated streaming documentation
tdas Jun 12, 2015
1ca431e
[SPARK-8329][SQL] Allow _ in DataSource options
marmbrus Jun 13, 2015
187a3d5
[Spark-8343] [Streaming] [Docs] Improve Spark Streaming Guides.
dusenberrymw Jun 14, 2015
4634be5
[SPARK-8354] [SQL] Fix off-by-factor-of-8 error when allocating scrat…
JoshRosen Jun 14, 2015
2805d14
[SPARK-8358] [SQL] Wait for child resolution when resolving generators
marmbrus Jun 14, 2015
0ffbf08
fix read/write mixup
hoffmann Jun 14, 2015
fff8d7e
SPARK-8336 Fix NullPointerException with functions.rand()
tedyu Jun 16, 2015
f287f7e
[SPARK-8367] [STREAMING] Add a limit for 'spark.streaming.blockInterv…
SaintBacchus Jun 16, 2015
1378bdc
[SPARK-DOCS] [SPARK-SQL] Update sql-programming-guide.md
moutai Jun 16, 2015
4da0686
[SQL] [DOC] improved a comment
radek1st Jun 16, 2015
b9e5d3c
[SPARK-8126] [BUILD] Make sure temp dir exists when running tests.
Jun 16, 2015
15d973f
[SPARK-7916] [MLLIB] MLlib Python doc parity check for classification…
yanboliang Jun 16, 2015
877deb0
Fix break introduced by backport
Jun 17, 2015
a5f602e
[SPARK-8309] [CORE] Support for more than 12M items in OpenHashMap
SlavikBaranov Jun 17, 2015
320c442
[SPARK-8395] [DOCS] start-slave.sh docs incorrect
srowen Jun 17, 2015
a7f6979
[SPARK-7515] [DOC] Update documentation for PySpark on YARN with clus…
Jun 17, 2015
d75c53d
[SPARK-8161] Set externalBlockStoreInitialized to be true, after Exte…
Jun 17, 2015
f051373
[SPARK-8372] History server shows incorrect information for applicati…
carsonwang Jun 17, 2015
5e7973d
[SPARK-8373] [PYSPARK] Add emptyRDD to pyspark and fix the issue when…
zsxwing Jun 17, 2015
5aedfa2
[SPARK-8404] [STREAMING] [TESTS] Use thread-safe collections to make …
zsxwing Jun 17, 2015
73cf5de
[SPARK-8306] [SQL] AddJar command needs to set the new class loader t…
yhuai Jun 17, 2015
67ad12d
[SPARK-8392] RDDOperationGraph: getting cached nodes is slow
XuTingjun Jun 18, 2015
9dabc12
[SPARK-8095] Resolve dependencies of --packages in local ivy cache
brkyvz Jun 18, 2015
ca23c3b
[SPARK-8202] [PYSPARK] fix infinite loop during external sort in PySpark
Jun 18, 2015
c1da5cf
[SPARK-8353] [DOCS] Show anchor links when hovering over documentatio…
JoshRosen Jun 18, 2015
9f293a9
[SPARK-8376] [DOCS] Add common lang3 to the Spark Flume Sink doc
zsxwing Jun 18, 2015
152f446
[SPARK-8446] [SQL] Add helper functions for testing SparkPlan physica…
JoshRosen Jun 18, 2015
bd9bbd6
[SPARK-8462] [DOCS] Documentation fixes for Spark SQL
lfrancke Jun 19, 2015
b55e4b9
[SPARK-8080] [STREAMING] Receiver.store with Iterator does not give c…
Jun 19, 2015
f48f3a2
[SPARK-8458] [SQL] Don't strip scheme part of output path when writin…
liancheng Jun 19, 2015
164b9d3
[SPARK-8339] [PYSPARK] integer division for python 3
kconor Jun 19, 2015
1f2dafb
[SPARK-8151] [MLLIB] pipeline components should correctly implement copy
mengxr Jun 19, 2015
6f2e411
[SPARK-8430] ExternalShuffleBlockResolver of shuffle service should s…
lianhuiwang Jun 19, 2015
aedd893
[SPARK-8451] [SPARK-7287] SparkSubmitSuite should check exit code
Jun 19, 2015
3415fb9
[SPARK-5836] [DOCS] [STREAMING] Clarify what may cause long-running S…
srowen Jun 19, 2015
4b2c793
[SPARK-7180] [SPARK-8090] [SPARK-8091] Fix a number of SerializationD…
tdas Jun 19, 2015
9ac8393
[SPARK-8368] [SPARK-8058] [SQL] HiveContext may override the context …
yhuai Jun 19, 2015
1a6b510
[SPARK-8452] [SPARKR] expose jobGroup API in SparkR
falaki Jun 19, 2015
0131142
[SPARK-8093] [SQL] Remove empty structs inferred from JSON documents
Jun 19, 2015
2510365
[HOT-FIX] Fix compilation (caused by 0131142d98b191f6cc112d383aa10582…
yhuai Jun 20, 2015
2248ad8
[SPARK-8498] [SQL] Add regression test for SPARK-8470
Jun 20, 2015
78d0cee
[SPARK-8389] [STREAMING] [KAFKA] Example of getting offset ranges out o…
koeninger Jun 19, 2015
a7b773a
[SPARK-8390] [STREAMING] [KAFKA] fix docs related to HasOffsetRanges
koeninger Jun 20, 2015
9b16508
[HOTFIX] [SPARK-8489] Correct JIRA number in previous commit
Jun 20, 2015
fe59a4a
[SPARK-8468] [ML] Take the negative of some metrics in RegressionEval…
viirya Jun 20, 2015
f0e4040
[SPARK-8379] [SQL] avoid speculative tasks write to the same file
jeanlyn Jun 21, 2015
2a7ea31
[SPARK-7715] [MLLIB] [ML] [DOC] Updated MLlib programming guide for r…
jkbradley Jun 21, 2015
b836bac
[HOTFIX] Hotfix branch-1.4 building by removing avgMetrics in CrossVa…
viirya Jun 22, 2015
451c872
[SPARK-8406] [SQL] Backports SPARK-8406 and PR #6864 to branch-1.4
liancheng Jun 22, 2015
6598161
[SPARK-8420] [SQL] Fix comparision of timestamps/dates with strings (…
marmbrus Jun 22, 2015
507381d
[SPARK-8511] [PYSPARK] Modify a test to remove a saved model in `regr…
yu-iskw Jun 22, 2015
994abba
[SPARK-8532] [SQL] In Python's DataFrameWriter, save/saveAsTable/json…
yhuai Jun 22, 2015
d73900a
[SPARK-7859] [SQL] Collect_set() behavior differences which fails the…
chenghao-intel Jun 23, 2015
2501794
[SPARK-8548] [SPARKR] Remove the trailing whitespaces from the SparkR…
yu-iskw Jun 23, 2015
48d6830
[BUILD] Preparing Spark release 1.4.1
pwendell Jun 23, 2015
d0a5560
Preparing Spark release v1.4.1-rc1
pwendell Jun 23, 2015
1cfa730
Preparing development version 1.4.2-SNAPSHOT
pwendell Jun 23, 2015
22cc1ab
[SPARK-7781] [MLLIB] gradient boosted trees.train regressor missing m…
holdenk Jun 23, 2015
d0943af
[SPARK-8541] [PYSPARK] test the absolute error in approx doctests
megatron-me-uk Jun 23, 2015
9294796
[SPARK-8483] [STREAMING] Remove commons-lang3 dependency from Flume Sink
harishreedharan Jun 23, 2015
3348245
[SPARK-8498] [TUNGSTEN] fix npe in errorhandling path in unsafeshuffl…
holdenk Jun 23, 2015
77cb1d5
Revert "[SPARK-8498] [TUNGSTEN] fix npe in errorhandling path in unsa…
JoshRosen Jun 23, 2015
27693e1
[SQL] [DOCS] updated the documentation for explode
lockwobr Jun 23, 2015
8d6e363
[SPARK-8525] [MLLIB] fix LabeledPoint parser when there is a whitespa…
fe2s Jun 23, 2015
13f7b0a
[SPARK-8573] [SPARK-8568] [SQL] [PYSPARK] raise Exception if column i…
Jun 23, 2015
8a4684b
Do not use a custom output commiter when appendiing data.
yhuai Jun 24, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
1 change: 1 addition & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -65,6 +65,7 @@ scalastyle.txt
scalastyle-output.xml
R-unit-tests.log
R/unit-tests.out
python/lib/pyspark.zip

# For Hive
metastore_db/
Expand Down
12 changes: 11 additions & 1 deletion .rat-excludes
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,10 +30,12 @@ spark-env.sh.template
log4j-defaults.properties
bootstrap-tooltip.js
jquery-1.11.1.min.js
d3.min.js
dagre-d3.min.js
graphlib-dot.min.js
sorttable.js
vis.min.js
vis.min.css
vis.map
.*avsc
.*txt
.*json
Expand Down Expand Up @@ -71,5 +73,13 @@ logs
.*scalastyle-output.xml
.*dependency-reduced-pom.xml
known_translations
json_expectation
local-1422981759269/*
local-1422981780767/*
local-1425081759269/*
local-1426533911241/*
local-1426633911242/*
local-1430917381534/*
DESCRIPTION
NAMESPACE
test_support/*
Loading