-
Notifications
You must be signed in to change notification settings - Fork 3.6k
Closed
Labels
3rd partyRelated to a 3rd-partyRelated to a 3rd-partydata handlingGeneric data-related topicGeneric data-related topicdocsDocumentation relatedDocumentation related
Milestone
Description
A team introduced ffcv which does optimizations in the dataloader level.
As long as it can be a drop in replacement for dataloader it should add the benefits to any PyTorch and Lightning script.
ie:
# current
data = Dataloader(...)
trainer.fit(..., data)
# 10x faster with ffcv
data = FFCVDataloader
trainer.fit(..., data)Let's make sure when users want to get the benefits of both FFCV and PL they can do that!
cc @Borda @rohitgr7 @Felonious-Spellfire @justusschock @awaelchli @ninginthecloud @otaj @tchaton @carmocca
kaushikb11, rohitgr7, F-Barto, AljoSt, eladsegal and 35 moreakihironitta, rohitgr7, Borda, F-Barto, its-dron and 11 morenateraw, zhiqwang, miraodasilva and hjander
Metadata
Metadata
Assignees
Labels
3rd partyRelated to a 3rd-partyRelated to a 3rd-partydata handlingGeneric data-related topicGeneric data-related topicdocsDocumentation relatedDocumentation related