Horovod v0.21: Optimizing Network Utilization with Local Gradient Aggregation and Grouped Allreduce
摘要
We originally open-sourced Horovod in 2017, and since then it has grown to become the standard solution in industry for scaling deep learning training to hundreds of GPUs. With Horovod, you can reduce training times from days or weeks to hours or minutes by adding just a few lines of Python code to an existing TensorFlow, PyTorch, or Apache MXNet training script.
欢迎在评论区写下你对这篇文章的看法。
