Skip to content

Commit da25c86

Browse files
yhuailiancheng
authored andcommitted
[SQL] Use path.makeQualified in newParquet.
Author: Yin Huai <[email protected]> Closes apache#5353 from yhuai/wrongFS and squashes the following commits: 849603b [Yin Huai] Not use deprecated method. 6d6ae34 [Yin Huai] Use path.makeQualified.
1 parent 9b40c17 commit da25c86

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

sql/core/src/main/scala/org/apache/spark/sql/parquet/newParquet.scala

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -268,7 +268,8 @@ private[sql] case class ParquetRelation2(
268268
// containing Parquet files (e.g. partitioned Parquet table).
269269
val baseStatuses = paths.distinct.map { p =>
270270
val fs = FileSystem.get(URI.create(p), sparkContext.hadoopConfiguration)
271-
val qualified = fs.makeQualified(new Path(p))
271+
val path = new Path(p)
272+
val qualified = path.makeQualified(fs.getUri, fs.getWorkingDirectory)
272273

273274
if (!fs.exists(qualified) && maybeSchema.isDefined) {
274275
fs.mkdirs(qualified)

0 commit comments

Comments
 (0)