All Projects → apache → Flume

apache / Flume

Licence: apache-2.0
Mirror of Apache Flume

Programming Languages

java
68154 projects - #9 most used programming language
Rich Text Format
576 projects
shell
77523 projects
powershell
5483 projects
python
139335 projects - #7 most used programming language
Thrift
134 projects

Projects that are alternatives of or similar to Flume

Bigdata Notes
大数据入门指南 ⭐
Stars: ✭ 10,991 (+399.59%)
Mutual labels:  big-data, flume
bigdata-fun
A complete (distributed) BigData stack, running in containers
Stars: ✭ 14 (-99.36%)
Mutual labels:  big-data, flume
Big Data Study
🐳 big data study
Stars: ✭ 141 (-93.59%)
Mutual labels:  big-data
Geopyspark
GeoTrellis for PySpark
Stars: ✭ 167 (-92.41%)
Mutual labels:  big-data
Datasciencevm
Tools and Docs on the Azure Data Science Virtual Machine (http://aka.ms/dsvm)
Stars: ✭ 153 (-93.05%)
Mutual labels:  big-data
Metamodel
Mirror of Apache Metamodel
Stars: ✭ 143 (-93.5%)
Mutual labels:  big-data
Geni
A Clojure dataframe library that runs on Spark
Stars: ✭ 152 (-93.09%)
Mutual labels:  big-data
Eel Sdk
Big Data Toolkit for the JVM
Stars: ✭ 140 (-93.64%)
Mutual labels:  big-data
Dvid
Distributed, Versioned, Image-oriented Dataservice
Stars: ✭ 174 (-92.09%)
Mutual labels:  big-data
Fili
Easily make RESTful web services for time series reporting with Big Data analytics engines like Druid and SQL Databases.
Stars: ✭ 151 (-93.14%)
Mutual labels:  big-data
Keyvi
Keyvi - the key value index. It is an in-memory FST-based data structure highly optimized for size and lookup performance.
Stars: ✭ 161 (-92.68%)
Mutual labels:  big-data
Spark With Python
Fundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (-93.18%)
Mutual labels:  big-data
Hydrograph
A visual ETL development and debugging tool for big data
Stars: ✭ 144 (-93.45%)
Mutual labels:  big-data
Presto
The official home of the Presto distributed SQL query engine for big data
Stars: ✭ 12,957 (+488.95%)
Mutual labels:  big-data
Storm Doc Zh
Apache Storm 官方文档中文版
Stars: ✭ 142 (-93.55%)
Mutual labels:  big-data
Attic Predictionio
PredictionIO, a machine learning server for developers and ML engineers.
Stars: ✭ 12,522 (+469.18%)
Mutual labels:  big-data
Belajarpython.com
Open Source Indonesian Python Programming Tutorial Site
Stars: ✭ 141 (-93.59%)
Mutual labels:  big-data
Parquetviewer
Simple windows desktop application for viewing & querying Apache Parquet files
Stars: ✭ 145 (-93.41%)
Mutual labels:  big-data
Spark.jl
Julia binding for Apache Spark
Stars: ✭ 153 (-93.05%)
Mutual labels:  big-data
Bigdata Playground
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Stars: ✭ 177 (-91.95%)
Mutual labels:  big-data

Welcome to Apache Flume!

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. The system is centrally managed and allows for intelligent dynamic management. It uses a simple extensible data model that allows for online analytic application.

The Apache Flume 1.x (NG) code line is a refactoring of the first generation Flume to solve certain known issues and limitations of the original design.

Apache Flume is open-sourced under the Apache Software Foundation License v2.0.

Documentation

Documentation is included in the binary distribution under the docs directory. In source form, it can be found in the flume-ng-doc directory.

The Flume 1.x guide and FAQ are available here:

Contact us!

Bug and Issue tracker.

Compiling Flume

Compiling Flume requires the following tools:

  • Oracle Java JDK 1.8
  • Apache Maven 3.x

Note: The Apache Flume build requires more memory than the default configuration. We recommend you set the following Maven options:

export MAVEN_OPTS="-Xms512m -Xmx1024m"

To compile Flume and build a distribution tarball, run mvn install from the top level directory. The artifacts will be placed under flume-ng-dist/target/.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].