We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 57ab41b commit ebdbd8cCopy full SHA for ebdbd8c
python/pyspark/sql/types.py
@@ -1698,7 +1698,7 @@ def _correct_date_of_dataframe_from_arrow(pdf, schema):
1698
""" Correct date type value to use datetime.date.
1699
1700
Pandas DataFrame created from PyArrow uses datetime64[ns] for date type values, but we should
1701
- use datetime.date to keep backward compatibility.
+ use datetime.date to match the behavior with when Arrow optimization is disabled.
1702
1703
:param pdf: pandas.DataFrame
1704
:param schema: a Spark schema of the pandas.DataFrame
0 commit comments