How can I use multiple GPUs on multiple Nodes in pytorch and slurm?

added help needed label

changed title from How can I use multiple GPUs on multiple Nodes in pytorch? to How can I use multiple GPUs on multiple Nodes in pytorch and slurm?

By till.riedel on 2022-05-18T10:52:47 (imported from GitLab)

assigned to @px3192

By till.riedel on 2022-05-18T10:53:48 (imported from GitLab)

assigned to @yiran.huang and unassigned @till.riedel