Skip to content

Conversation

@yongtang
Copy link
Member

This PR wrap the IOTensor function as a callable class, so that it is easy to manage. In the past, when IOTensor function is called, it expect several non-regular args such as component, column names, label field etc. This makes it hard to manage.

This PR wrap the IOTensor function as a callable class and any non-input are part of the class member. At the end IOTensor expect a function of :

function(resource, start, stop) # or __call__(self, resource, start, stop).

In this way, all functions could be passed around with the same type of processing.

This PR also removed step arg as we could not support it anyway.

Signed-off-by: Yong Tang [email protected]

Signed-off-by: Yong Tang <[email protected]>
Signed-off-by: Yong Tang <[email protected]>
Signed-off-by: Yong Tang <[email protected]>
Signed-off-by: Yong Tang <[email protected]>
Signed-off-by: Yong Tang <[email protected]>
Signed-off-by: Yong Tang <[email protected]>
Signed-off-by: Yong Tang <[email protected]>
Signed-off-by: Yong Tang <[email protected]>
Signed-off-by: Yong Tang <[email protected]>
Signed-off-by: Yong Tang <[email protected]>
@yongtang
Copy link
Member Author

This is a refactor without any API change or new addition, so will just merge shortly.

@yongtang yongtang merged commit 5bbb94c into tensorflow:master Sep 19, 2019
@yongtang yongtang deleted the items branch September 19, 2019 13:28
i-ony pushed a commit to i-ony/io that referenced this pull request Feb 8, 2021
* Remove step arg as it could not be supported in C++ anyway

Signed-off-by: Yong Tang <[email protected]>

* Fix audio and lmdb

Signed-off-by: Yong Tang <[email protected]>

* Fix prometheus

Signed-off-by: Yong Tang <[email protected]>

* Fix Kafka

Signed-off-by: Yong Tang <[email protected]>

* Fix CSV

Signed-off-by: Yong Tang <[email protected]>

* Fix HDF5

Signed-off-by: Yong Tang <[email protected]>

* Fix JSON

Signed-off-by: Yong Tang <[email protected]>

* Pylint fix

Signed-off-by: Yong Tang <[email protected]>

* Fix feather

Signed-off-by: Yong Tang <[email protected]>

* LMDB naming change

Signed-off-by: Yong Tang <[email protected]>

* Remove the need to specify label

Signed-off-by: Yong Tang <[email protected]>

* Fix Kafka

Signed-off-by: Yong Tang <[email protected]>

* Make output name consistent

Signed-off-by: Yong Tang <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant