Skip to content

Commit c74d715

Browse files
committed
Merge remote-tracking branch 'upstream/master' into fix-json-nonnumric
Conflicts: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JSONOptions.scala sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JacksonParser.scala sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonParsingOptionsSuite.scala sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala
2 parents 6d90b24 + 4a5ee19 commit c74d715

File tree

4,305 files changed

+283671
-107401
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

4,305 files changed

+283671
-107401
lines changed

.github/PULL_REQUEST_TEMPLATE

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
## What changes were proposed in this pull request?
2+
3+
(Please fill in changes proposed in this fix)
4+
5+
6+
## How was this patch tested?
7+
8+
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
9+
10+
11+
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)
12+

.gitignore

Lines changed: 48 additions & 50 deletions
Original file line numberDiff line numberDiff line change
@@ -1,81 +1,79 @@
1-
*~
2-
*.#*
31
*#*#
4-
*.swp
5-
*.ipr
2+
*.#*
63
*.iml
4+
*.ipr
75
*.iws
86
*.pyc
97
*.pyo
8+
*.swp
9+
*~
10+
.DS_Store
11+
.cache
12+
.classpath
13+
.ensime
14+
.ensime_cache/
15+
.ensime_lucene
16+
.generated-mima*
1017
.idea/
1118
.idea_modules/
12-
build/*.jar
19+
.project
20+
.scala_dependencies
1321
.settings
14-
.cache
15-
cache
16-
.generated-mima*
17-
work/
18-
out/
19-
.DS_Store
20-
third_party/libmesos.so
21-
third_party/libmesos.dylib
22+
/lib/
23+
R-unit-tests.log
24+
R/unit-tests.out
25+
build/*.jar
2226
build/apache-maven*
23-
build/zinc*
2427
build/scala*
25-
conf/java-opts
26-
conf/*.sh
28+
build/zinc*
29+
cache
30+
checkpoint
2731
conf/*.cmd
28-
conf/*.properties
2932
conf/*.conf
33+
conf/*.properties
34+
conf/*.sh
3035
conf/*.xml
36+
conf/java-opts
3137
conf/slaves
38+
dependency-reduced-pom.xml
39+
derby.log
40+
dev/create-release/*final
41+
dev/create-release/*txt
42+
dist/
3243
docs/_site
3344
docs/api
34-
target/
35-
reports/
36-
.project
37-
.classpath
38-
.scala_dependencies
3945
lib_managed/
40-
src_managed/
46+
lint-r-report.log
47+
log/
48+
logs/
49+
out/
4150
project/boot/
42-
project/plugins/project/build.properties
4351
project/build/target/
44-
project/plugins/target/
4552
project/plugins/lib_managed/
53+
project/plugins/project/build.properties
4654
project/plugins/src_managed/
47-
logs/
48-
log/
55+
project/plugins/target/
56+
python/lib/pyspark.zip
57+
reports/
58+
scalastyle-on-compile.generated.xml
59+
scalastyle-output.xml
60+
scalastyle.txt
61+
spark-*-bin-*.tgz
4962
spark-tests.log
63+
src_managed/
5064
streaming-tests.log
51-
dependency-reduced-pom.xml
52-
.ensime
53-
.ensime_cache/
54-
.ensime_lucene
55-
checkpoint
56-
derby.log
57-
dist/
58-
dev/create-release/*txt
59-
dev/create-release/*final
60-
spark-*-bin-*.tgz
65+
target/
6166
unit-tests.log
62-
/lib/
63-
ec2/lib/
64-
rat-results.txt
65-
scalastyle.txt
66-
scalastyle-output.xml
67-
R-unit-tests.log
68-
R/unit-tests.out
69-
python/lib/pyspark.zip
70-
lint-r-report.log
67+
work/
7168

7269
# For Hive
73-
metastore_db/
74-
metastore/
75-
warehouse/
7670
TempStatsStore/
71+
metastore/
72+
metastore_db/
7773
sql/hive-thriftserver/test_warehouses
74+
warehouse/
75+
spark-warehouse/
7876

7977
# For R session data
80-
.RHistory
8178
.RData
79+
.RHistory

.rat-excludes

Lines changed: 0 additions & 86 deletions
This file was deleted.

.travis.yml

Lines changed: 51 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,51 @@
1+
# Licensed to the Apache Software Foundation (ASF) under one or more
2+
# contributor license agreements. See the NOTICE file distributed with
3+
# this work for additional information regarding copyright ownership.
4+
# The ASF licenses this file to You under the Apache License, Version 2.0
5+
# (the "License"); you may not use this file except in compliance with
6+
# the License. You may obtain a copy of the License at
7+
#
8+
# http://www.apache.org/licenses/LICENSE-2.0
9+
#
10+
# Unless required by applicable law or agreed to in writing, software
11+
# distributed under the License is distributed on an "AS IS" BASIS,
12+
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
13+
# See the License for the specific language governing permissions and
14+
# limitations under the License.
15+
16+
# Spark provides this Travis CI configuration file to help contributors
17+
# check Scala/Java style conformance and JDK7/8 compilation easily
18+
# during their preparing pull requests.
19+
# - Scalastyle is executed during `maven install` implicitly.
20+
# - Java Checkstyle is executed by `lint-java`.
21+
# See the related discussion here.
22+
# https://github.com/apache/spark/pull/12980
23+
24+
# 1. Choose OS (Ubuntu 14.04.3 LTS Server Edition 64bit, ~2 CORE, 7.5GB RAM)
25+
sudo: required
26+
dist: trusty
27+
28+
# 2. Choose language and target JDKs for parallel builds.
29+
language: java
30+
jdk:
31+
- oraclejdk7
32+
- oraclejdk8
33+
34+
# 3. Setup cache directory for SBT and Maven.
35+
cache:
36+
directories:
37+
- $HOME/.sbt
38+
- $HOME/.m2
39+
40+
# 4. Turn off notifications.
41+
notifications:
42+
email: false
43+
44+
# 5. Run maven install before running lint-java.
45+
install:
46+
- export MAVEN_SKIP_RC=1
47+
- build/mvn -T 4 -q -DskipTests -Pyarn -Phadoop-2.3 -Pkinesis-asl -Phive -Phive-thriftserver install
48+
49+
# 6. Run lint-java.
50+
script:
51+
- dev/lint-java

LICENSE

Lines changed: 20 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,3 @@
1-
21
Apache License
32
Version 2.0, January 2004
43
http://www.apache.org/licenses/
@@ -237,9 +236,9 @@ The following components are provided under a BSD-style license. See project lin
237236
The text of each license is also included at licenses/LICENSE-[project].txt.
238237

239238
(BSD 3 Clause) netlib core (com.github.fommil.netlib:core:1.1.2 - https://github.com/fommil/netlib-java/core)
240-
(BSD 3 Clause) JPMML-Model (org.jpmml:pmml-model:1.1.15 - https://github.com/jpmml/jpmml-model)
241-
(BSD 3-clause style license) jblas (org.jblas:jblas:1.2.4 - http://jblas.org/)
239+
(BSD 3 Clause) JPMML-Model (org.jpmml:pmml-model:1.2.7 - https://github.com/jpmml/jpmml-model)
242240
(BSD License) AntLR Parser Generator (antlr:antlr:2.7.7 - http://www.antlr.org/)
241+
(BSD License) ANTLR 4.5.2-1 (org.antlr:antlr4:4.5.2-1 - http://wwww.antlr.org/)
243242
(BSD licence) ANTLR ST4 4.0.4 (org.antlr:ST4:4.0.4 - http://www.stringtemplate.org)
244243
(BSD licence) ANTLR StringTemplate (org.antlr:stringtemplate:3.2.1 - http://www.stringtemplate.org)
245244
(BSD License) Javolution (javolution:javolution:5.5.1 - http://javolution.org)
@@ -250,22 +249,21 @@ The text of each license is also included at licenses/LICENSE-[project].txt.
250249
(Interpreter classes (all .scala files in repl/src/main/scala
251250
except for Main.Scala, SparkHelper.scala and ExecutorClassLoader.scala),
252251
and for SerializableMapWrapper in JavaUtils.scala)
253-
(BSD-like) Scala Actors library (org.scala-lang:scala-actors:2.10.5 - http://www.scala-lang.org/)
254-
(BSD-like) Scala Compiler (org.scala-lang:scala-compiler:2.10.5 - http://www.scala-lang.org/)
255-
(BSD-like) Scala Compiler (org.scala-lang:scala-reflect:2.10.5 - http://www.scala-lang.org/)
256-
(BSD-like) Scala Library (org.scala-lang:scala-library:2.10.5 - http://www.scala-lang.org/)
257-
(BSD-like) Scalap (org.scala-lang:scalap:2.10.5 - http://www.scala-lang.org/)
258-
(BSD-style) scalacheck (org.scalacheck:scalacheck_2.10:1.10.0 - http://www.scalacheck.org)
259-
(BSD-style) spire (org.spire-math:spire_2.10:0.7.1 - http://spire-math.org)
260-
(BSD-style) spire-macros (org.spire-math:spire-macros_2.10:0.7.1 - http://spire-math.org)
261-
(New BSD License) Kryo (com.esotericsoftware.kryo:kryo:2.21 - http://code.google.com/p/kryo/)
262-
(New BSD License) MinLog (com.esotericsoftware.minlog:minlog:1.2 - http://code.google.com/p/minlog/)
263-
(New BSD License) ReflectASM (com.esotericsoftware.reflectasm:reflectasm:1.07 - http://code.google.com/p/reflectasm/)
252+
(BSD-like) Scala Actors library (org.scala-lang:scala-actors:2.11.7 - http://www.scala-lang.org/)
253+
(BSD-like) Scala Compiler (org.scala-lang:scala-compiler:2.11.7 - http://www.scala-lang.org/)
254+
(BSD-like) Scala Compiler (org.scala-lang:scala-reflect:2.11.7 - http://www.scala-lang.org/)
255+
(BSD-like) Scala Library (org.scala-lang:scala-library:2.11.7 - http://www.scala-lang.org/)
256+
(BSD-like) Scalap (org.scala-lang:scalap:2.11.7 - http://www.scala-lang.org/)
257+
(BSD-style) scalacheck (org.scalacheck:scalacheck_2.11:1.10.0 - http://www.scalacheck.org)
258+
(BSD-style) spire (org.spire-math:spire_2.11:0.7.1 - http://spire-math.org)
259+
(BSD-style) spire-macros (org.spire-math:spire-macros_2.11:0.7.1 - http://spire-math.org)
260+
(New BSD License) Kryo (com.esotericsoftware:kryo:3.0.3 - https://github.com/EsotericSoftware/kryo)
261+
(New BSD License) MinLog (com.esotericsoftware:minlog:1.3.0 - https://github.com/EsotericSoftware/minlog)
264262
(New BSD license) Protocol Buffer Java API (com.google.protobuf:protobuf-java:2.5.0 - http://code.google.com/p/protobuf)
265263
(New BSD license) Protocol Buffer Java API (org.spark-project.protobuf:protobuf-java:2.4.1-shaded - http://code.google.com/p/protobuf)
266264
(The BSD License) Fortran to Java ARPACK (net.sourceforge.f2j:arpack_combined_all:0.1 - http://f2j.sourceforge.net)
267265
(The BSD License) xmlenc Library (xmlenc:xmlenc:0.52 - http://xmlenc.sourceforge.net)
268-
(The New BSD License) Py4J (net.sf.py4j:py4j:0.9 - http://py4j.sourceforge.net/)
266+
(The New BSD License) Py4J (net.sf.py4j:py4j:0.10.1 - http://py4j.sourceforge.net/)
269267
(Two-clause BSD-style license) JUnit-Interface (com.novocode:junit-interface:0.10 - http://github.com/szeiger/junit-interface/)
270268
(BSD licence) sbt and sbt-launch-lib.bash
271269
(BSD 3 Clause) d3.min.js (https://github.com/mbostock/d3/blob/master/LICENSE)
@@ -284,11 +282,17 @@ The text of each license is also included at licenses/LICENSE-[project].txt.
284282
(MIT License) SLF4J API Module (org.slf4j:slf4j-api:1.7.5 - http://www.slf4j.org)
285283
(MIT License) SLF4J LOG4J-12 Binding (org.slf4j:slf4j-log4j12:1.7.5 - http://www.slf4j.org)
286284
(MIT License) pyrolite (org.spark-project:pyrolite:2.0.1 - http://pythonhosted.org/Pyro4/)
287-
(MIT License) scopt (com.github.scopt:scopt_2.10:3.2.0 - https://github.com/scopt/scopt)
285+
(MIT License) scopt (com.github.scopt:scopt_2.11:3.2.0 - https://github.com/scopt/scopt)
288286
(The MIT License) Mockito (org.mockito:mockito-core:1.9.5 - http://www.mockito.org)
289287
(MIT License) jquery (https://jquery.org/license/)
290288
(MIT License) AnchorJS (https://github.com/bryanbraun/anchorjs)
291289
(MIT License) graphlib-dot (https://github.com/cpettitt/graphlib-dot)
292290
(MIT License) dagre-d3 (https://github.com/cpettitt/dagre-d3)
293291
(MIT License) sorttable (https://github.com/stuartlangridge/sorttable)
294292
(MIT License) boto (https://github.com/boto/boto/blob/develop/LICENSE)
293+
(MIT License) datatables (http://datatables.net/license)
294+
(MIT License) mustache (https://github.com/mustache/mustache/blob/master/LICENSE)
295+
(MIT License) cookies (http://code.google.com/p/cookies/wiki/License)
296+
(MIT License) blockUI (http://jquery.malsup.com/block/)
297+
(MIT License) RowsGroup (http://datatables.net/license/mit)
298+
(MIT License) jsonFormatter (http://www.jqueryscript.net/other/jQuery-Plugin-For-Pretty-JSON-Formatting-jsonFormatter.html)

0 commit comments

Comments
 (0)