Horovod+NCCL
Mixed precision
BytePS: https://github.com/bytedance/byteps
Last updated 4 years ago
Was this helpful?