-
-
Notifications
You must be signed in to change notification settings - Fork 153
Closed
Description
Tracking issue for local query.
Todo:
Add .arrows format by implementing FileFormat. Datafusion only supports IPC file format not the streaming format which we use.- Add arrow partition streams to table provider
- While reading compact record batches to save space.
- Create table provider that joins local and remote query together in right order.
- ( Optional ) Support projection pushdown.
- Add atomic file references so that no arrow files are removed during query.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request