Wrong mesh order

[ad8e]

torchtitan/torchtitan/parallelisms/__init__.py

Line 46 in d442743

[self.dp, self.tp, self.pp], ["dp", "tp", "pp"], strict=True

Should be PP DP TP. This matters for NUMA across nodes.

[wanchaol]

good catch! submitting a fix soon