# Distributed training

Horovod+NCCL

Mixed precision

BytePS: [https://github.com/bytedance/byteps](https://github.com/bytedance/byteps)
