Skip to content

Commit 0fa747e

Browse files
authored
use better default decoder for prototype dataset tests (#4863)
1 parent b9f4ed9 commit 0fa747e

File tree

1 file changed

+7
-1
lines changed

1 file changed

+7
-1
lines changed

test/builtin_dataset_mocks.py

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -100,10 +100,16 @@ def _get(self, dataset, config):
100100
return mock_resources, mock_info
101101

102102
def _decoder(self, dataset_type):
103+
def to_bytes(file):
104+
try:
105+
return file.read()
106+
finally:
107+
file.close()
108+
103109
if dataset_type == datasets.utils.DatasetType.RAW:
104110
return datasets.decoder.raw
105111
else:
106-
return lambda file: file.close()
112+
return to_bytes
107113

108114
def load(
109115
self, name: str, decoder=DEFAULT_TEST_DECODER, split="train", **options: Any

0 commit comments

Comments
 (0)