Horovod

Horovod is a framework for distributing training of Deep Learning models across multiple GPUs, which may be running on multiple machines

Logo

../_images/horovod_horovod-small.png

Website

https://horovod.ai

Repository

https://github.com/horovod/horovod

Byline

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

License

Apache 2.0

Project age

3 years 10 months

Backers

Linux Foundation AI & Data (Governed by), Uber (Creator)

Lastest News (2021-05-19)

Release v0.22.0 PyTorch Lightning Estimator, Nsight profiling, PyTorch 1.9 support. more

Size score (1 to 10, higher is better)

5.25

Trend score (1 to 10, higher is better)

5.0

Education Resources

URL

Resource Type

Description

https://horovod.readthedocs.io/en/stable/summary_include.html

Documentation

Official project documentation.

https://youtu.be/4y0TDK3KoCA

Video

This is a good tutorial video.

Git Commit Statistics

Statistics computed using Git data through May 31, 2021.

Statistic

Lifetime

Last 12 Months

Commits

20,594

5,906

Lines committed

4,163,486

1,145,822

Unique committers

140

60

Core committers

16

10

../_images/horovod_horovod-monthly-commits.png

Similar Projects

Project

Size Score

Trend Score

Byline

Analytics Zoo

5.0

8.25

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

Ray

8.0

9.0

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.