File tree Expand file tree Collapse file tree 1 file changed +5
-0
lines changed
docs/guides/06_distributed_training Expand file tree Collapse file tree 1 file changed +5
-0
lines changed Original file line number Diff line number Diff line change @@ -424,7 +424,9 @@ train_fleet_static.py的完整训练代码如下所示。
424424
425425 2.2.4 构建dataset加载数据
426426""""""""""""
427+
427428.. code-block :: python
429+
428430 # 具体数据处理参考examples/wide_and_deep_dataset中reader.py
429431 dataset = paddle.distributed.QueueDataset()
430432 thread_num = 1
@@ -436,6 +438,7 @@ train_fleet_static.py的完整训练代码如下所示。
436438 train_files_list = [os.path.join(train_data_path, x)
437439 for x in os.listdir(train_data_path)]
438440 dataset.set_filelist(train_files_list)
441+
439442 备注:dataset具体用法参见\ `使用InMemoryDataset/QueueDataset进行训练 <https://fleet-x.readthedocs.io/en/latest/paddle_fleet_rst/parameter_server/performance/dataset.html >`_\。
440443
441444
@@ -475,6 +478,7 @@ train_fleet_static.py的完整训练代码如下所示。
475478同样对于训练节点,用 ``init_worker() `` 接口进行初始化后, 开始执行训练任务。运行 ``exe.train_from_dataset() `` 接口开始训练。
476479
477480.. code-block :: python
481+
478482 if fleet.is_server():
479483 fleet.init_server()
480484 fleet.run_server()
@@ -494,6 +498,7 @@ train_fleet_static.py的完整训练代码如下所示。
494498 print_period = 1 )
495499
496500 fleet.stop_worker()
501+
497502 备注:Paddle2.3版本及以后,ParameterServer训练将废弃掉dataloader + exe.run()方式,请切换到dataset + exe.train_from_dataset()方式。
498503
499504
You can’t perform that action at this time.
0 commit comments