Skip to content

Property TPUSpawnPlugin.tpu_global_core_rank may be replaced by global rank property #10986

@awaelchli

Description

@awaelchli

Proposed refactor

Deprecate tpu_global_core_rank in favor of global_rank.

Pitch

It "looks" like tpu_global_core_rank in the TPUPlugin is just another name for what is known as the global rank. After #10896 we should investigate whether the two are equivalent and revert back to using the unified global_rank property exclusively.


If you enjoy Lightning, check out our other projects! ⚡

  • Metrics: Machine learning metrics for distributed, scalable PyTorch applications.

  • Lite: enables pure PyTorch users to scale their existing code on any kind of device while retaining full control over their own loops and optimization logic.

  • Flash: The fastest way to get a Lightning baseline! A collection of tasks for fast prototyping, baselining, fine-tuning, and solving problems with deep learning.

  • Bolts: Pretrained SOTA Deep Learning models, callbacks, and more for research and production with PyTorch Lightning and PyTorch.

  • Lightning Transformers: Flexible interface for high-performance research using SOTA Transformers leveraging Pytorch Lightning, Transformers, and Hydra.

cc @Borda @kaushikb11 @rohitgr7 @justusschock @awaelchli @akihironitta @tchaton

Metadata

Metadata

Assignees

Type

No type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions