File tree Expand file tree Collapse file tree 1 file changed +4
-2
lines changed
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet Expand file tree Collapse file tree 1 file changed +4
-2
lines changed Original file line number Diff line number Diff line change @@ -198,9 +198,11 @@ private[sql] object ParquetFilters {
198198 // which can be casted to `false` implicitly. Please refer to the `eval` method of these
199199 // operators and the `SimplifyFilters` rule for details.
200200
201- // Hyukjin: I added [[EqualNullSafe]] with [[org.apache.parquet.filter2.predicate.Operators.Eq]].
201+ // Hyukjin:
202+ // I added [[EqualNullSafe]] with [[org.apache.parquet.filter2.predicate.Operators.Eq]].
202203 // So, it performs equality comparison identically when given [[sources.Filter]] is [[EqualTo]].
203- // The reason why I did this is, that the actual Parquet filter checks null-safe equality comparison.
204+ // The reason why I did this is, that the actual Parquet filter checks null-safe equality
205+ // comparison.
204206 // So I added this and maybe [[EqualTo]] should be changed. It still seems fine though, because
205207 // physical planning does not set `NULL` to [[EqualTo]] but changes it to [[IsNull]] and etc.
206208 // Probably I missed something and obviously this should be changed.
You can’t perform that action at this time.
0 commit comments