Skip to content

Adding an RPC Tutorial #807

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Jan 13, 2020
Merged

Adding an RPC Tutorial #807

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
b4e9f21
Adding an RPC Tutorial
mrshenli Jan 2, 2020
494f02f
Address comments
mrshenli Jan 3, 2020
1292597
address comments
mrshenli Jan 3, 2020
7c0b10e
address comments
mrshenli Jan 3, 2020
6b1d310
address comments
mrshenli Jan 9, 2020
2ac1794
Add sample training outputs for RL example
mrshenli Jan 9, 2020
62f6fd2
Address comments
mrshenli Jan 10, 2020
755bd2f
Fix typos
mrshenli Jan 10, 2020
110920f
fix typos
mrshenli Jan 10, 2020
2a57256
Add warning
mrshenli Jan 10, 2020
2d8032d
Merge branch 'master' of https://github.com/pytorch/tutorials into rpc
mrshenli Jan 10, 2020
c66913a
Address Comments
mrshenli Jan 10, 2020
6a62f96
Distinguish single-machine and distributed model parallel
mrshenli Jan 10, 2020
6c7d597
User relative URLs
mrshenli Jan 10, 2020
08acbc3
Address comments
mrshenli Jan 10, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions index.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -203,6 +203,11 @@ Parallel and Distributed Training
:description: :doc:`/intermediate/dist_tuto`
:figure: _static/img/distributed/DistPyTorch.jpg

.. customgalleryitem::
:tooltip: Getting Started with Distributed RPC Framework
:description: :doc:`/intermediate/rpc_tutorial`
:figure: _static/img/distributed/DistPyTorch.jpg

.. customgalleryitem::
:tooltip: PyTorch distributed trainer with Amazon AWS
:description: :doc:`/beginner/aws_distributed_training_tutorial`
Expand Down Expand Up @@ -377,6 +382,7 @@ PyTorch Fundamentals In-Depth
intermediate/model_parallel_tutorial
intermediate/ddp_tutorial
intermediate/dist_tuto
intermediate/rpc_tutorial
beginner/aws_distributed_training_tutorial

.. toctree::
Expand Down
9 changes: 8 additions & 1 deletion intermediate_source/model_parallel_tutorial.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# -*- coding: utf-8 -*-
"""
Model Parallel Best Practices
Single-Machine Model Parallel Best Practices
================================
**Author**: `Shen Li <https://mrshenli.github.io/>`_

Expand All @@ -27,6 +27,13 @@
of model parallel. It is up to the readers to apply the ideas to real-world
applications.

.. note::

For distributed model parallel training where a model spans multiple
servers, please refer to
`Getting Started With Distributed RPC Framework <rpc_tutorial.html>`__
for examples and details.

Basic Usage
-----------
"""
Expand Down
Loading