[Algorithm] QMixer loss and multiagent models

docs/source/reference/modules.rst

@@ -335,6 +335,20 @@ algorithms, such as DQN, DDPG or Dreamer.
     RSSMPrior
     RSSMPosterior
 
+Multi-agent-specific modules
+~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+These networks implement models that can be used in
+multi-agent contexts.
+
+.. autosummary::
+    :toctree: generated/
+    :template: rl_template_noinherit.rst
+
+    MultiAgentMLP
+    QMixer
+    VDNMixer
+
 
 Exploration
 -----------

docs/source/reference/objectives.rst

@@ -185,6 +185,21 @@ Dreamer
     DreamerModelLoss
     DreamerValueLoss
 
+Multi-agent objectives
+----------------------
+.. currentmodule:: torchrl.objectives.multiagent
+
+These objectives are specific to multi-agent algorithms.
+
+QMixer
+~~~~~~
+
+.. autosummary::
+    :toctree: generated/
+    :template: rl_template_noinherit.rst
+
+    QMixerLoss
+
 
 Returns
 -------

setup.py

@@ -235,6 +235,7 @@ def _main(argv):
             "checkpointing": [
                 "torchsnapshot",
             ],
+            "marl": ["vmas"],
         },
         zip_safe=False,
         classifiers=[
@@ -254,5 +255,4 @@ def _main(argv):
 
 
 if __name__ == "__main__":
-
     _main(sys.argv[1:])