espnet2.gan_codec.shared.quantizer.modules.distrib.sync_grad

source

espnet2.gan_codec.shared.quantizer.modules.distrib.sync_grad(params)

Simpler alternative to DistributedDataParallel, that doesn’t rely on any black magic. For simple models it can also be as fast. Just call this on your model parameters after the call to backward!