espnet2.train.distributed_utils.get_num_nodes

source

espnet2.train.distributed_utils.get_num_nodes(prior=None, launcher: str | None = None) → int | None

Get the number of nodes.

Use for “multiprocessing distributed” mode. RANK equals to the Node id in this case and the real Rank is set as (nGPU * NodeID) + LOCAL_RANK in torch.distributed.