Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
325 commits
Select commit Hold shift + click to select a range
3dfa4ea
[SPARK-11322] [PYSPARK] Keep full stack trace in captured exception
viirya Oct 29, 2015
87f28fc
[SPARK-11379][SQL] ExpressionEncoder can't handle top level primitive…
cloud-fan Oct 29, 2015
f79ebf2
[SPARK-11370] [SQL] fix a bug in GroupedIterator and create unit test…
cloud-fan Oct 29, 2015
f304f9c
[SPARK-11318] Include hive profile in make-distribution.sh command
tedyu Oct 29, 2015
3bb2a8d
[SPARK-11388][BUILD] Fix self closing tags.
hvanhovell Oct 29, 2015
f7a51de
[SPARK-11246] [SQL] Table cache for Parquet broken in 1.5
xwu0226 Oct 29, 2015
8185f03
[SPARK-11188][SQL] Elide stacktraces in bin/spark-sql for AnalysisExc…
dilipbiswal Oct 29, 2015
a01cbf5
[SPARK-10641][SQL] Add Skewness and Kurtosis Support
sethah Oct 29, 2015
f21ef8d
[SPARK-10532][EC2] Added --profile option to specify the name of profile
teramonagi Oct 29, 2015
4f5e60c
[SPARK-11236][CORE] Update Tachyon dependency from 0.7.1 -> 0.8.0.
calvinjia Oct 29, 2015
96cf87f
[SPARK-11301] [SQL] fix case sensitivity for filter on partitioned co…
cloud-fan Oct 29, 2015
d89be0b
[SPARK-11409][SPARKR] Enable url link in R doc for Persist
felixcheung Oct 30, 2015
56419cf
[SPARK-10342] [SPARK-10309] [SPARK-10474] [SPARK-10929] [SQL] Coopera…
Oct 30, 2015
eb59b94
[SPARK-11417] [SQL] no @Override in codegen
Oct 30, 2015
86d6526
[SPARK-11207] [ML] Add test cases for solver selection of LinearRegres…
Lewuathe Oct 30, 2015
59db9e9
[SPARK-11103][SQL] Filter applied on Merged Parquet shema with new co…
HyukjinKwon Oct 30, 2015
14d08b9
[SPARK-11393] [SQL] CoGroupedIterator should respect the fact that Gr…
cloud-fan Oct 30, 2015
0451b00
[SPARK-10986][MESOS] Set the context class loader in the Mesos execut…
dragos Oct 30, 2015
fab710a
[SPARK-11414][SPARKR] Forgot to update usage of 'spark.sparkr.r.comma…
Oct 30, 2015
40c77fb
[SPARK-11210][SPARKR] Add window functions into SparkR [step 2].
Oct 30, 2015
729f983
[SPARK-11342][TESTS] Allow to set hadoop profile when running dev/ru…
zjffdu Oct 30, 2015
bb5a2af
[SPARK-11340][SPARKR] Support setting driver properties when starting…
felixcheung Oct 30, 2015
45029bf
[SPARK-11423] remove MapPartitionsWithPreparationRDD
Oct 30, 2015
e8ec2a7
Revert "[SPARK-11236][CORE] Update Tachyon dependency from 0.7.1 -> 0…
yhuai Oct 30, 2015
69b9e4b
[SPARK-11385] [ML] foreachActive made public in MLLib's vector API
Oct 31, 2015
3c47188
[SPARK-11434][SPARK-11103][SQL] Fix test ": Filter applied on merged …
yhuai Oct 31, 2015
97b3c8f
[SPARK-11226][SQL] Empty line in json file should be skipped
zjffdu Oct 31, 2015
ac4118d
[SPARK-11424] Guard against double-close() of RecordReaders
JoshRosen Oct 31, 2015
fc27dfb
[SPARK-11024][SQL] Optimize NULL in <inlist-expressions> by folding i…
dilipbiswal Oct 31, 2015
40d3c67
[SPARK-11265][YARN] YarnClient can't get tokens to talk to Hive 1.2.1…
steveloughran Nov 1, 2015
aa494a9
[SPARK-11117] [SPARK-11345] [SQL] Makes all HadoopFsRelation data sou…
liancheng Nov 1, 2015
643c49c
[SPARK-11305][DOCS] Remove Third-Party Hadoop Distributions Doc Page
srowen Nov 1, 2015
fae9bba
Take R types instead to map to JVM types, add check for NA to keep co…
felixcheung Nov 1, 2015
dc7e399
[SPARK-11338] [WEBUI] Prepend app links on HistoryPage with uiRoot path
ckadner Nov 1, 2015
49f7117
This seems to fix the Rd error - no idea why it worked before.
felixcheung Nov 1, 2015
046e32e
[SPARK-11410][SQL] Add APIs to provide functionality similar to Hive'…
nongli Nov 1, 2015
cf04fdf
[SPARK-11020][CORE] Wait for HDFS to leave safe mode before initializ…
Nov 1, 2015
f8d93ed
[SPARK-11073][CORE][YARN] Remove akka dependency in secret key genera…
Nov 1, 2015
8d3f043
fix test broken from column name change from cast
felixcheung Nov 2, 2015
3e770a6
[SPARK-9298][SQL] Add pearson correlation aggregation function
viirya Nov 2, 2015
e963070
[SPARK-9722] [ML] Pass random seed to spark.ml DecisionTree*
yu-iskw Nov 2, 2015
e209fa2
[SPARK-11271][SPARK-11016][CORE] Use Spark BitSet instead of RoaringB…
viirya Nov 2, 2015
ea4a3e7
[SPARK-11413][BUILD] Bump joda-time version to 2.9 for java 8 and s3
yongjiaw Nov 2, 2015
767522d
[SPARK-10786][SQL] Take the whole statement to generate the CommandPr…
SaintBacchus Nov 2, 2015
74ba952
[SPARK-11311][SQL] spark cannot describe temporary functions
adrian-wang Nov 2, 2015
a930e62
[SPARK-9817][YARN] Improve the locality calculation of containers by …
jerryshao Nov 2, 2015
71d1c90
[SPARK-10997][CORE] Add "client mode" to netty rpc env.
Nov 2, 2015
f92f334
[SPARK-11437] [PYSPARK] Don't .take when converting RDD to DataFrame …
JasonMWhite Nov 2, 2015
b3aedca
[SPARK-11456][TESTS] Remove deprecated junit.framework in Java tests
srowen Nov 2, 2015
33ae7a3
[SPARK-11358][MLLIB] deprecate runs in k-means
mengxr Nov 2, 2015
db11ee5
[SPARK-11371] Make "mean" an alias for "avg" operator
tedyu Nov 2, 2015
2804674
[SPARK-11383][DOCS] Replaced example code in mllib-naive-bayes.md/mll…
rishabhbhardwaj Nov 2, 2015
ecfb3e7
[SPARK-10286][ML][PYSPARK][DOCS] Add @since annotation to pyspark.ml.…
lidinghao Nov 3, 2015
ec03866
[SPARK-11343][ML] Allow float and double prediction/label columns in …
Nov 3, 2015
c020f7d
[SPARK-10592] [ML] [PySpark] Deprecate weights and use coefficients i…
vectorijk Nov 3, 2015
476f434
[SPARK-11236] [TEST-MAVEN] [TEST-HADOOP1.0] [CORE] Update Tachyon dep…
calvinjia Nov 3, 2015
21ad846
[MINOR][ML] removed the old `getModelWeights` function
Nov 3, 2015
2cef1bb
[SPARK-5354][SQL] Cached tables should preserve partitioning and ord…
nongli Nov 3, 2015
9cb5c73
[SPARK-11329][SQL] Support star expansion for structs.
nongli Nov 3, 2015
efaa472
[SPARK-11432][GRAPHX] Personalized PageRank shouldn't use uniform ini…
Nov 3, 2015
9cf56c9
[SPARK-11469][SQL] Allow users to define nondeterministic udfs.
yhuai Nov 3, 2015
c34c27f
[SPARK-9034][SQL] Reflect field names defined in GenericUDTF
navis Nov 3, 2015
d728d5c
[SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add an ExchangeCoordinator …
yhuai Nov 3, 2015
67e23b3
[SPARK-10429] [SQL] make mutableProjection atomic
Nov 3, 2015
425ff03
[SPARK-11436] [SQL] rebind right encoder when join 2 datasets
cloud-fan Nov 3, 2015
b86f2ca
[SPARK-11404] [SQL] Support for groupBy using column expressions
marmbrus Nov 3, 2015
233e534
[SPARK-11344] Made ApplicationDescription and DriverDescription case …
jacek-lewandowski Nov 3, 2015
d188a67
[SPARK-10533][SQL] handle scientific notation in sqlParser
adrian-wang Nov 3, 2015
57446eb
[SPARK-11256] Mark all Stage/ResultStage/ShuffleMapStage internal sta…
rxin Nov 3, 2015
d6035d9
[SPARK-10304] [SQL] Partition discovery should throw an exception if …
viirya Nov 3, 2015
d6f10aa
[SPARK-9836][ML] Provide R-like summary statistics for OLS via normal…
yanboliang Nov 3, 2015
3434572
[MINOR][ML] Fix naming conventions of AFTSurvivalRegression coefficients
yanboliang Nov 3, 2015
f54ff19
[SPARK-11349][ML] Support transform string label for RFormula
yanboliang Nov 3, 2015
b2e4b31
[SPARK-9790][YARN] Expose in WebUI if NodeManager is the reason why e…
markgrover Nov 3, 2015
ebf8b0b
[SPARK-10978][SQL] Allow data sources to eliminate filters
liancheng Nov 3, 2015
a9676cc
[SPARK-11407][SPARKR] Add doc for running from RStudio
felixcheung Nov 3, 2015
1d04dc9
[SPARK-11467][SQL] add Python API for stddev/variance
Nov 3, 2015
f6fcb48
[SPARK-11477] [SQL] support create Dataset from RDD
cloud-fan Nov 3, 2015
680b4e7
Fix typo in WebUI
Nov 3, 2015
53e9cee
[SPARK-11466][CORE] Avoid mockito in multi-threaded FsHistoryProvider…
Nov 4, 2015
5051262
[SPARK-11489][SQL] Only include common first order statistics in Grou…
rxin Nov 4, 2015
d648a4a
[DOC] Missing link to R DataFrame API doc
Lewuathe Nov 4, 2015
e352de0
[SPARK-11329] [SQL] Cleanup from spark-11329 fix.
Nov 4, 2015
2692bdb
[SPARK-11455][SQL] fix case sensitivity of partition by
cloud-fan Nov 4, 2015
8aff36e
[SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen)
jerryshao Nov 4, 2015
c09e513
[SPARK-11442] Reduce numSlices for local metrics test of SparkListene…
tedyu Nov 4, 2015
e328b69
[SPARK-9492][ML][R] LogisticRegression in R should provide model stat…
yanboliang Nov 4, 2015
820064e
[SPARK-11380][DOCS] Replace example code in mllib-frequent-pattern-mi…
pravingadakh Nov 4, 2015
9b214ce
[SPARK-11443] Reserve space lines
yinxusen Nov 4, 2015
8790ee6
[SPARK-10622][CORE][YARN] Differentiate dead from "mostly dead" execu…
Nov 4, 2015
27feafc
[SPARK-11235][NETWORK] Add ability to stream data using network lib.
Nov 4, 2015
cd1df66
[SPARK-11485][SQL] Make DataFrameHolder and DatasetHolder public.
rxin Nov 4, 2015
e0fc9c7
[SPARK-11197][SQL] add doc for run SQL on files directly
cloud-fan Nov 4, 2015
3bd6f5d
[SPARK-11490][SQL] variance should alias var_samp instead of var_pop.
rxin Nov 4, 2015
987df4b
Closes #9464
rxin Nov 4, 2015
de289bf
[SPARK-10304][SQL] Following up checking valid dir structure for part…
viirya Nov 4, 2015
abf5e42
[SPARK-11504][SQL] API audit for distributeBy and localSort
rxin Nov 4, 2015
d19f4fd
[SPARK-11505][SQL] Break aggregate functions into multiple files
rxin Nov 4, 2015
701fb50
[SPARK-10949] Update Snappy version to 1.1.2
a-roberts Nov 4, 2015
1b6a5d4
[SPARK-11493] remove bitset from BytesToBytesMap
Nov 4, 2015
411ff6a
[SPARK-10028][MLLIB][PYTHON] Add Python API for PrefixSpan
yu-iskw Nov 4, 2015
b6e0a5a
[SPARK-11510][SQL] Remove SQL aggregation tests for higher order stat…
rxin Nov 5, 2015
ce5e6a2
[SPARK-11491] Update build to use Scala 2.10.5
JoshRosen Nov 5, 2015
a752dda
[SPARK-11398] [SQL] unnecessary def dialectClassName in HiveContext, …
Nov 5, 2015
d0b5633
[SPARK-11307] Reduce memory consumption of OutputCommitCoordinator
JoshRosen Nov 5, 2015
81498dd
[SPARK-11425] [SPARK-11486] Improve hybrid aggregation
Nov 5, 2015
6f81eae
[SPARK-11440][CORE][STREAMING][BUILD] Declare rest of @Experimental i…
srowen Nov 5, 2015
859dff5
[SPARK-11378][STREAMING] make StreamingContext.awaitTerminationOrTime…
ontarionick Nov 5, 2015
7bdc921
[SPARK-11449][CORE] PortableDataStream should be a factory
hvanhovell Nov 5, 2015
a94671a
[SPARK-11506][MLLIB] Removed redundant operation in Online LDA implem…
a1singh Nov 5, 2015
77488fb
[MINOR][SQL] A minor log line fix
liancheng Nov 5, 2015
72634f2
[MINOR][ML][DOC] Rename weights to coefficients in user guide
yanboliang Nov 5, 2015
2e86cf1
[SPARK-11527][ML][PYSPARK] PySpark AFTSurvivalRegressionModel should …
yanboliang Nov 5, 2015
a4b5cef
[SPARK-11501][CORE][YARN] Propagate spark.rpc config to executors
nishkamravi2 Nov 5, 2015
b072ff4
[SPARK-11474][SQL] change fetchSize to fetchsize
Nov 5, 2015
9da7cee
[SPARK-11473][ML] R-like summary statistics with intercept for OLS vi…
yanboliang Nov 5, 2015
c76865c
[SPARK-11484][WEBUI] Using proxyBase set by spark AM
Nov 5, 2015
6b87acd
[SPARK-11513][SQL] Remove implicit conversion from LogicalPlan to Dat…
rxin Nov 5, 2015
f80f7b6
[SPARK-10265][DOCUMENTATION, ML] Fixed @Since annotation to ml.regres…
ehsanmok Nov 5, 2015
14ee0f5
[SPARK-10648] Oracle dialect to handle nonspecific numeric types
travishegner Nov 5, 2015
8a5314e
[SPARK-11532][SQL] Remove implicit conversion from Expression to Column
rxin Nov 5, 2015
b9455d1
[SPARK-11260][SPARKR] with() function support
adrian555 Nov 5, 2015
d9e30c5
[SPARK-10656][SQL] completely support special chars in DataFrame
cloud-fan Nov 5, 2015
b6974f8
[SPARK-11536][SQL] Remove the internal implicit conversion from Expre…
rxin Nov 5, 2015
2440106
[SPARK-11542] [SPARKR] fix glm with long fomular
Nov 6, 2015
07414af
[SPARK-11537] [SQL] fix negative hours/minutes/seconds
Nov 6, 2015
6091e91
Revert "[SPARK-11469][SQL] Allow users to define nondeterministic udfs."
rxin Nov 6, 2015
8fa8c83
[SPARK-11514][ML] Pass random seed to spark.ml DecisionTree*
yu-iskw Nov 6, 2015
468ad0a
[SPARK-11457][STREAMING][YARN] Fix incorrect AM proxy filter conf rec…
jerryshao Nov 6, 2015
5e31db7
[SPARK-11538][BUILD] Force guava 14 in sbt build.
Nov 6, 2015
3cc2c05
[SPARK-11540][SQL] API audit for QueryExecutionListener.
rxin Nov 6, 2015
eec74ba
[SPARK-7542][SQL] Support off-heap index/sort buffer
Nov 6, 2015
363a476
[SPARK-11528] [SQL] Typed aggregations for Datasets
marmbrus Nov 6, 2015
bc5d6c0
[SPARK-11541][SQL] Break JdbcDialects.scala into multiple files and m…
rxin Nov 6, 2015
253e87e
[SPARK-11453][SQL][FOLLOW-UP] remove DecimalLit
cloud-fan Nov 6, 2015
cf69ce1
[SPARK-11511][STREAMING] Fix NPE when an InputDStream is not used
zsxwing Nov 6, 2015
574141a
[SPARK-9162] [SQL] Implement code generation for ScalaUDF
viirya Nov 6, 2015
c048929
[SPARK-10978][SQL][FOLLOW-UP] More comprehensive tests for PR #9399
liancheng Nov 6, 2015
8211aab
[SPARK-9858][SQL] Add an ExchangeCoordinator to estimate the number o…
yhuai Nov 6, 2015
62bb290
Typo fixes + code readability improvements
Nov 6, 2015
49f1a82
[SPARK-10116][CORE] XORShiftRandom.hashSeed is random in high bits
squito Nov 6, 2015
f328fed
[SPARK-11450] [SQL] Add Unsafe Row processing to Expand
hvanhovell Nov 6, 2015
3a652f6
[SPARK-11561][SQL] Rename text data source's column name to value.
rxin Nov 6, 2015
c447c9d
[SPARK-11217][ML] save/load for non-meta estimators and transformers
mengxr Nov 6, 2015
f6680cd
[SPARK-11555] spark on yarn spark-class --num-workers doesn't work
Nov 6, 2015
7e9a9e6
[SPARK-11269][SQL] Java API support & test cases for Dataset
cloud-fan Nov 6, 2015
1ab72b0
[SPARK-11410] [PYSPARK] Add python bindings for repartition and sortW…
nongli Nov 6, 2015
6d0ead3
[SPARK-9241][SQL] Supporting multiple DISTINCT columns (2) - Rewritin…
hvanhovell Nov 7, 2015
1c80d66
[SPARK-11546] Thrift server makes too many logs about result schema
navis Nov 7, 2015
105732d
[HOTFIX] Fix python tests after #9527
marmbrus Nov 7, 2015
30b706b
[SPARK-11389][CORE] Add support for off-heap memory to MemoryManager
JoshRosen Nov 7, 2015
7f74190
[SPARK-11112] DAG visualization: display RDD callsite
Nov 7, 2015
2ff0e79
[SPARK-8467] [MLLIB] [PYSPARK] Add LDAModel.describeTopics() in Python
yu-iskw Nov 7, 2015
ef36284
[SPARK-9241][SQL] Supporting multiple DISTINCT columns - follow-up
hvanhovell Nov 7, 2015
4b69a42
[SPARK-11362] [SQL] Use Spark BitSet in BroadcastNestedLoopJoin
viirya Nov 8, 2015
d981902
[SPARK-11476][DOCS] Incorrect function referred to in MLib Random dat…
srowen Nov 8, 2015
5c4e6d7
[DOC][SQL] Remove redundant out-of-place python snippet
rohitagarwal003 Nov 8, 2015
30c8ba7
[SPARK-11451][SQL] Support single distinct count on multiple columns.
hvanhovell Nov 8, 2015
2673905
[SPARK-10046][SQL] Hive warehouse dir not set in current directory wh…
xwu0226 Nov 8, 2015
b2d195e
[SPARK-11554][SQL] add map/flatMap to GroupedDataset
cloud-fan Nov 8, 2015
97b7080
[SPARK-11564][SQL] Dataset Java API audit
rxin Nov 9, 2015
d8b50f7
[SPARK-11453][SQL] append data to partitioned table will messes up th…
cloud-fan Nov 9, 2015
9e48cdf
[SPARK-11218][CORE] show help messages for start-slave and start-master
Nov 9, 2015
b541b31
[DOC][MINOR][SQL] Fix internal link
rohitagarwal003 Nov 9, 2015
8c0e1b5
[SPARK-11494][ML][R] Expose R-like summary statistics in SparkR::glm …
yanboliang Nov 9, 2015
d50a66c
[SPARK-10689][ML][DOC] User guide and example code for AFTSurvivalReg…
yanboliang Nov 9, 2015
9b88e1d
[SPARK-11582][MLLIB] specifying pmml version attribute =4.2 in the ro…
Nov 9, 2015
08a7a83
[SPARK-10565][CORE] add missing web UI stats to /api/v1/applications …
Nov 9, 2015
404a28f
[SPARK-11112] Fix Scala 2.11 compilation error in RDDInfo.scala
tedyu Nov 9, 2015
cd17488
[SPARK-9865][SPARKR] Flaky SparkR test: test_sparkSQL.R: sample on a …
felixcheung Nov 9, 2015
874cd66
[DOCS] Fix typo for Python section on unifying Kafka streams
Nov 9, 2015
860ea0d
[SPARK-11581][DOCS] Example mllib code in documentation incorrectly c…
bharatl Nov 9, 2015
88a3fdc
[SPARK-10280][MLLIB][PYSPARK][DOCS] Add @since annotation to pyspark.…
yu-iskw Nov 9, 2015
5039a49
[SPARK-10471][CORE][MESOS] prevent getting offers for unmet constraints
FelixBechstein0000 Nov 9, 2015
51d41e4
[SPARK-11552][DOCS][Replaced example code in ml-decision-tree.md usin…
agsachin Nov 9, 2015
b7720fa
[SPARK-11548][DOCS] Replaced example code in mllib-collaborative-filt…
rishabhbhardwaj Nov 9, 2015
f138cb8
[SPARK-9301][SQL] Add collect_set and collect_list aggregate functions
nburoojy Nov 9, 2015
150f6a8
[SPARK-11595] [SQL] Fixes ADD JAR when the input path contains URL sc…
liancheng Nov 9, 2015
a3a7c91
[SPARK-11359][STREAMING][KINESIS] Checkpoint to DynamoDB even when ne…
brkyvz Nov 9, 2015
8a23368
[SPARK-6517][MLLIB] Implement the Algorithm of Hierarchical Clustering
yu-iskw Nov 9, 2015
fcb57e9
[SPARK-11564][SQL][FOLLOW-UP] improve java api for GroupedDataset
cloud-fan Nov 9, 2015
9565c24
[SPARK-9557][SQL] Refactor ParquetFilterSuite and remove old ParquetF…
HyukjinKwon Nov 9, 2015
2f38378
[SPARK-11360][DOC] Loss of nullability when writing parquet files
gatorsmile Nov 10, 2015
9c740a9
[SPARK-11578][SQL] User API for Typed Aggregation
marmbrus Nov 10, 2015
675c7e7
[SPARK-11564][SQL] Fix documentation for DataFrame.take/collect
rxin Nov 10, 2015
7dc9d8d
[SPARK-11610][MLLIB][PYTHON][DOCS] Make the docs of LDAModel.describe…
yu-iskw Nov 10, 2015
61f9c87
[SPARK-11069][ML] Add RegexTokenizer option to convert to lowercase
hhbyyh Nov 10, 2015
26062d2
[SPARK-11198][STREAMING][KINESIS] Support de-aggregation of records d…
brkyvz Nov 10, 2015
0ce6f9b
[SPARK-11141][STREAMING] Batch ReceivedBlockTrackerLogEvents for WAL …
brkyvz Nov 10, 2015
1f0f14e
[SPARK-11462][STREAMING] Add JavaStreamingListener
zsxwing Nov 10, 2015
6502944
[SPARK-11333][STREAMING] Add executorId to ReceiverInfo and display i…
zsxwing Nov 10, 2015
1431319
Add mockito as an explicit test dependency to spark-streaming
brkyvz Nov 10, 2015
c4e19b3
[SPARK-11587][SPARKR] Fix the summary generic to match base R
shivaram Nov 10, 2015
d6cd3a1
[SPARK-11599] [SQL] fix NPE when resolve Hive UDF in SQLParser
Nov 10, 2015
521b3ca
[SPARK-11598] [SQL] enable tests for ShuffledHashOuterJoin
Nov 10, 2015
5507a9d
Fix typo in driver page
pestilence669 Nov 10, 2015
a81f47f
[SPARK-11382] Replace example code in mllib-decision-tree.md using in…
yinxusen Nov 10, 2015
689386b
[SPARK-7841][BUILD] Stop using retrieveManaged to retrieve dependenci…
JoshRosen Nov 10, 2015
6e5fc37
[SPARK-11252][NETWORK] ShuffleClient should release connection after …
lianhuiwang Nov 10, 2015
e0701c7
[SPARK-9830][SQL] Remove AggregateExpression1 and Aggregate Operator …
yhuai Nov 10, 2015
47735cd
[SPARK-10863][SPARKR] Method coltypes() (New version)
Nov 10, 2015
dfcfcbc
[SPARK-11578][SQL][FOLLOW-UP] complete the user facing api for typed …
cloud-fan Nov 10, 2015
5360085
[SPARK-11590][SQL] use native json_tuple in lateral view
cloud-fan Nov 10, 2015
87aedc4
[SPARK-10371][SQL] Implement subexpr elimination for UnsafeProjections
nongli Nov 10, 2015
f14e951
[ML][R] SparkR::glm summary result to compare with native R
yanboliang Nov 10, 2015
18350a5
[SPARK-11618][ML] Minor refactoring of basic ML import/export
jkbradley Nov 10, 2015
dba1a62
[SPARK-7316][MLLIB] RDD sliding window with step
Nov 10, 2015
724cf7a
[SPARK-11616][SQL] Improve toString for Dataset
marmbrus Nov 10, 2015
638c51d
[SPARK-11550][DOCS] Replace example code in mllib-optimization.md usi…
pravingadakh Nov 10, 2015
32790fe
[SPARK-11567] [PYTHON] Add Python API for corr Aggregate function
felixcheung Nov 10, 2015
1dde39d
[SPARK-9818] Re-enable Docker tests for JDBC data source
JoshRosen Nov 10, 2015
e281b87
[SPARK-5565][ML] LDA wrapper for Pipelines API
jkbradley Nov 11, 2015
3121e78
[SPARK-9830][SPARK-11641][SQL][FOLLOW-UP] Remove AggregateExpression1…
yhuai Nov 11, 2015
21c562f
[SPARK-9241][SQL] Supporting multiple DISTINCT columns - follow-up (3)
hvanhovell Nov 11, 2015
a398905
[SPARK-10827][CORE] AppClient should not use `askWithReply` in `recei…
BryanCutler Nov 11, 2015
c0e48df
[SPARK-11566] [MLLIB] [PYTHON] Refactoring GaussianMixtureModel.gauss…
yu-iskw Nov 11, 2015
33112f9
[SPARK-10192][CORE] simple test w/ failure involving a shared dependency
squito Nov 11, 2015
3e0a6cf
[SPARK-11572] Exit AsynchronousListenerBus thread when stop() is called
tedyu Nov 11, 2015
9009175
[SPARK-11615] Drop @VisibleForTesting annotation
tedyu Nov 11, 2015
6600786
[SPARK-11361][STREAMING] Show scopes of RDD operations inside DStream…
tdas Nov 11, 2015
12c7635
[MINOR] Fix typo in AggregationQuerySuite.scala
saurfang Nov 11, 2015
745e45d
[MINOR] License header formatting fix
marcprux Nov 11, 2015
6e101d2
[SPARK-6726][ML] Import/export for spark.ml LogisticRegressionModel
jkbradley Nov 11, 2015
fac53d8
[SPARK-10192][HOTFIX] Fix NPE in test that was added in #8402
JoshRosen Nov 11, 2015
1a8e046
[SPARK-11468] [SPARKR] add stddev/variance agg functions for Column
felixcheung Nov 11, 2015
bd70244
[SPARK-11463] [PYSPARK] only install signal in main thread
Nov 11, 2015
99f5f98
[SPARK-11290][STREAMING] Basic implementation of trackStateByKey
tdas Nov 11, 2015
1bc4112
[SPARK-11500][SQL] Not deterministic order of columns when using merg…
HyukjinKwon Nov 11, 2015
1510c52
[SPARK-10371][SQL][FOLLOW-UP] fix code style
cloud-fan Nov 11, 2015
27524a3
[SPARK-11626][ML] ml.feature.Word2Vec.transform() function very slow
Nov 11, 2015
95daff6
[SPARK-11646] WholeTextFileRDD should return Text rather than String
rxin Nov 11, 2015
c964fc1
[SQL][MINOR] rename present to finish in Aggregator
cloud-fan Nov 11, 2015
9c57bc0
[SPARK-11656][SQL] support typed aggregate in project list
cloud-fan Nov 11, 2015
ec2b807
[SPARK-11564][SQL][FOLLOW-UP] clean up java tuple encoder
cloud-fan Nov 11, 2015
e71ba56
[SQL][MINOR] remove newLongEncoder in functions
cloud-fan Nov 11, 2015
529a1d3
[SPARK-6152] Use shaded ASM5 to support closure cleaning of Java 8 co…
JoshRosen Nov 11, 2015
27029bc
[SPARK-11639][STREAMING][FLAKY-TEST] Implement BlockingWriteAheadLog …
brkyvz Nov 11, 2015
df97df2
[SPARK-11644][SQL] Remove the option to turn off unsafe and codegen.
rxin Nov 11, 2015
a9a6b80
[SPARK-11645][SQL] Remove OpenHashSet for the old aggregate.
rxin Nov 11, 2015
dd77e27
[SPARK-11335][STREAMING] update kafka direct python docs on how to ge…
ontarionick Nov 11, 2015
2d76e44
[SPARK-11647] Attempt to reduce time/flakiness of Thriftserver CLI an…
JoshRosen Nov 11, 2015
e1bcf6a
[SPARK-10827] replace volatile with Atomic* in AppClient.scala.
rxin Nov 11, 2015
1a21be1
[SPARK-11672][ML] disable spark.ml read/write tests
mengxr Nov 11, 2015
b8ff688
[SPARK-8992][SQL] Add pivot to dataframe api
aray Nov 12, 2015
a40838a
Add support for colnames, colnames<-, coltypes<-
felixcheung Oct 22, 2015
3343047
Take R types instead to map to JVM types, add check for NA to keep co…
felixcheung Nov 1, 2015
969dc0e
This seems to fix the Rd error - no idea why it worked before.
felixcheung Nov 1, 2015
4e820ec
fix test broken from column name change from cast
felixcheung Nov 2, 2015
e2399b5
rebase, merge with coltypes change, fix generic, doc
felixcheung Nov 12, 2015
8730a37
Merge branch 'colnamescoltypes' of https://github.com/felixcheung/spa…
felixcheung Nov 12, 2015
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
10 changes: 5 additions & 5 deletions LICENSE
Original file line number Diff line number Diff line change
Expand Up @@ -250,11 +250,11 @@ The text of each license is also included at licenses/LICENSE-[project].txt.
(Interpreter classes (all .scala files in repl/src/main/scala
except for Main.Scala, SparkHelper.scala and ExecutorClassLoader.scala),
and for SerializableMapWrapper in JavaUtils.scala)
(BSD-like) Scala Actors library (org.scala-lang:scala-actors:2.10.4 - http://www.scala-lang.org/)
(BSD-like) Scala Compiler (org.scala-lang:scala-compiler:2.10.4 - http://www.scala-lang.org/)
(BSD-like) Scala Compiler (org.scala-lang:scala-reflect:2.10.4 - http://www.scala-lang.org/)
(BSD-like) Scala Library (org.scala-lang:scala-library:2.10.4 - http://www.scala-lang.org/)
(BSD-like) Scalap (org.scala-lang:scalap:2.10.4 - http://www.scala-lang.org/)
(BSD-like) Scala Actors library (org.scala-lang:scala-actors:2.10.5 - http://www.scala-lang.org/)
(BSD-like) Scala Compiler (org.scala-lang:scala-compiler:2.10.5 - http://www.scala-lang.org/)
(BSD-like) Scala Compiler (org.scala-lang:scala-reflect:2.10.5 - http://www.scala-lang.org/)
(BSD-like) Scala Library (org.scala-lang:scala-library:2.10.5 - http://www.scala-lang.org/)
(BSD-like) Scalap (org.scala-lang:scalap:2.10.5 - http://www.scala-lang.org/)
(BSD-style) scalacheck (org.scalacheck:scalacheck_2.10:1.10.0 - http://www.scalacheck.org)
(BSD-style) spire (org.spire-math:spire_2.10:0.7.1 - http://spire-math.org)
(BSD-style) spire-macros (org.spire-math:spire-macros_2.10:0.7.1 - http://spire-math.org)
Expand Down
1 change: 1 addition & 0 deletions R/pkg/DESCRIPTION
Original file line number Diff line number Diff line change
Expand Up @@ -34,4 +34,5 @@ Collate:
'serialize.R'
'sparkR.R'
'stats.R'
'types.R'
'utils.R'
25 changes: 23 additions & 2 deletions R/pkg/NAMESPACE
Original file line number Diff line number Diff line change
Expand Up @@ -23,9 +23,13 @@ export("setJobGroup",
exportClasses("DataFrame")

exportMethods("arrange",
"as.data.frame",
"attach",
"cache",
"collect",
"colnames",
"coltypes",
"coltypes<-",
"columns",
"count",
"cov",
Expand Down Expand Up @@ -83,6 +87,7 @@ exportMethods("arrange",
"unique",
"unpersist",
"where",
"with",
"withColumn",
"withColumnRenamed",
"write.df")
Expand Down Expand Up @@ -119,12 +124,14 @@ exportMethods("%in%",
"count",
"countDistinct",
"crc32",
"cumeDist",
"date_add",
"date_format",
"date_sub",
"datediff",
"dayofmonth",
"dayofyear",
"denseRank",
"desc",
"endsWith",
"exp",
Expand All @@ -150,8 +157,11 @@ exportMethods("%in%",
"isNaN",
"isNotNull",
"isNull",
"kurtosis",
"lag",
"last",
"last_day",
"lead",
"least",
"length",
"levenshtein",
Expand All @@ -177,17 +187,21 @@ exportMethods("%in%",
"nanvl",
"negate",
"next_day",
"ntile",
"otherwise",
"percentRank",
"pmod",
"quarter",
"rand",
"randn",
"rank",
"regexp_extract",
"regexp_replace",
"reverse",
"rint",
"rlike",
"round",
"rowNumber",
"rpad",
"rtrim",
"second",
Expand All @@ -196,12 +210,17 @@ exportMethods("%in%",
"shiftLeft",
"shiftRight",
"shiftRightUnsigned",
"sd",
"sign",
"signum",
"sin",
"sinh",
"size",
"skewness",
"soundex",
"stddev",
"stddev_pop",
"stddev_samp",
"sqrt",
"startsWith",
"substr",
Expand All @@ -220,6 +239,10 @@ exportMethods("%in%",
"unhex",
"unix_timestamp",
"upper",
"var",
"variance",
"var_pop",
"var_samp",
"weekofyear",
"when",
"year")
Expand Down Expand Up @@ -254,5 +277,3 @@ export("structField",
"structType.jobj",
"structType.structField",
"print.structType")

export("as.data.frame")
Loading