Beam

Apache Beam originated from Google’s Dataflow Model in 2014. In 2016, Google donated Dataflow Model. Later with other community members’ contribution and improvement, it became Apache Beam.

Logo

../_images/apache_beam-small.png

Website

https://beam.apache.org/

Repository

https://github.com/apache/beam

Byline

Apache Beam is a unified model for defining both batch and streaming data-parallel processing pipelines, as well as a set of language-specific SDKs for constructing pipelines and Runners for executing them on distributed processing backends, including Apache Flink, Apache Spark, Google Cloud Dataflow and Hazelcast Jet.

License

Apache 2.0

Project age

7 years 9 months

Backers

Apache (Governed by), Google (Creator)

Lastest News (2021-06-09)

Beam 2.30.0 release We are happy to present the new 2.30.0 release of Beam. This release includes both improvements and new … more

Size score (1 to 10, higher is better)

9.0

Trend score (1 to 10, higher is better)

7.5

Education Resources

URL

Resource Type

Description

https://beam.apache.org/documentation/

Documentation

Official project documentation.

Git Commit Statistics

Statistics computed using Git data through March 31, 2022.

Statistic

Lifetime

Last 12 Months

Commits

75,521

35,547

Lines committed

34,642,402

7,877,036

Unique committers

1,291

293

Core committers

22

26

../_images/apache_beam-monthly-commits.png

Similar Projects

Project

Size Score

Trend Score

Byline

Flink

9.25

7.25

Apache Flink is an open source stream processing framework with powerful stream- and batch-processing capabilities.

Hudi

6.25

9.25

Hudi is a rich platform to build streaming data lakes with incremental data pipelines on a self-managing database layer, while being optimized for lake engines and regular batch processing.

NiFi

8.25

6.5

Apache NiFi supports highly configurable directed graphs of data routing, transformation, and system mediation logic.

Storm

6.75

3.25

Storm is a distributed realtime computation system.