Skip to content

ParquetDataset support configuration with default value #156

@Markz2z

Description

@Markz2z

User Story

The fixed-length features in TFRecord support configuration with default values(https://www.tensorflow.org/api_docs/python/tf/io/FixedLenFeature), but currently, Parquet does not support this feature. If encountering a non-existent feature, an error will be thrown, such as 'No Column called xx found in yy'.

So when we transition from training with TFRecord to Parquet, there may be some functionality alignment issues. We hope that Parquet can also support configuration with default values.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions