Luigi

Luigi is for batch jobs, which solves the complicated workflow and dependcy management in Hadoop world.

Logo

../_images/spotify_luigi-small.png

Website

N/A

Repository

https://github.com/spotify/luigi

Byline

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

License

Apache 2.0

Project age

9 years 6 months

Backers

Spotify (Creator and maintainer)

Size score (1 to 10, higher is better)

4.25

Trend score (1 to 10, higher is better)

3.75

Education Resources

URL

Resource Type

Description

https://luigi.readthedocs.io/en/stable/

Documentation

Official project documentation.

Git Commit Statistics

Statistics computed using Git data through May 31, 2021.

Statistic

Lifetime

Last 12 Months

Commits

6,003

221

Lines committed

591,350

45,591

Unique committers

591

27

Core committers

20

6

../_images/spotify_luigi-monthly-commits.png

Similar Projects

Project

Size Score

Trend Score

Byline

Airflow

7.25

7.75

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Cromwell

4.25

5.0

Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments

Snakemake

6.0

5.75

The Snakemake workflow management system is a tool to create reproducible and scalable data analyses