Skip to content

Commit 42a9c56

Browse files
Egor Krivokonekrivokonmapr
authored andcommitted
MapR [SPARK-883] Spark-3.1.1 job submition (apache#818)
1 parent 4f25f96 commit 42a9c56

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

conf/spark-defaults.conf

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,6 +15,8 @@ spark.sql.warehouse.dir maprfs:///user/${system:user.name}/spark-ware
1515
# Fix for SPARK-7819
1616
spark.sql.hive.metastore.sharedPrefixes com.mysql.jdbc,org.postgresql,com.microsoft.sqlserver,oracle.jdbc,com.mapr.fs.shim.LibraryLoader,com.mapr.security.JNISecurity,com.mapr.fs.jni,com.mapr.fs.ShimLoader
1717

18-
spark.sql.hive.metastore.jars /opt/mapr/spark/spark-2.4.5/jars/*,/opt/mapr/lib/*
18+
spark.sql.hive.metastore.jars /opt/mapr/spark/spark-3.1.1/jars/*,/opt/mapr/lib/*
19+
20+
spark.sql.hive.metastore.version 2.3
1921

2022
spark.executor.memory 2g

0 commit comments

Comments
 (0)