Skip to content

Commit 73320e8

Browse files
committed
Improve comment.
1 parent 2c76a91 commit 73320e8

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/OptimizeJsonExprs.scala

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -29,8 +29,9 @@ import org.apache.spark.sql.types.{ArrayType, StructType}
2929
* 1. JsonToStructs(StructsToJson(child)) => child.
3030
* 2. Prune unnecessary columns from GetStructField/GetArrayStructFields + JsonToStructs.
3131
* 3. CreateNamedStruct(JsonToStructs(json).col1, JsonToStructs(json).col2, ...) =>
32-
* CreateNamedStruct(JsonToStructs(json)) if JsonToStructs(json) is shared among all
33-
* fields of CreateNamedStruct.
32+
* If(IsNull(json), nullStruct, KnownNotNull(JsonToStructs(prunedSchema, ..., json)))
33+
* if JsonToStructs(json) is shared among all fields of CreateNamedStruct. `prunedSchema`
34+
* contains all accessed fields in original CreateNamedStruct.
3435
*/
3536
object OptimizeJsonExprs extends Rule[LogicalPlan] {
3637
override def apply(plan: LogicalPlan): LogicalPlan = plan transform {

0 commit comments

Comments
 (0)