Skip to content

Commit 8812f64

Browse files
committed
Comment for UDT
1 parent 85ce339 commit 8812f64

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystReadSupport.scala

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -127,6 +127,8 @@ private[parquet] object CatalystReadSupport {
127127
clipParquetGroup(parquetType.asGroupType(), t)
128128

129129
case _ =>
130+
// UDTs and primitive types are not clipped. For UDTs, a clipped version might not be able
131+
// to be mapped to desired user-space types. So UDTs shouldn't participate schema merging.
130132
parquetType
131133
}
132134
}

0 commit comments

Comments
 (0)