1215 Open source projects that are alternatives of or similar to Eel Sdk

Hive Storage Handler for interoperability between BigQuery and Apache Hive

Information Inference Service of the OpenAIRE system

rastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)

同步Hive数据仓库数据到Elasticsearch的小工具

A lightweight stream processing library for Go

☁️ nodejs kafka connect connector for Google BigQuery

An alternative to the "hive standalone" jar for connecting Java applications to Apache Hive via JDBC

Apache Parquet

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

Manage Apache Atlas and Ranger configuration for your Hadoop environment.

Distributed Stream and Batch Processing

Smart Automation Tool for building modern Data Lakes and Data Pipelines

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

Today I Learned

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

MySQL to NoSQL real time dataflow

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

python ETL framework

Samples to the Oracle Big Data Lite VM

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

A complete (distributed) BigData stack, running in containers

Mapreduce project by Hadoop, Nutch, AWS EMR, Pig, Tez, Hive

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

A tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.

An extensible Java framework for building XML and non-XML streaming applications

Gathers scalable tensorflow and infrastructure deployment

大数据学习笔记，学习路线，技术案例整理。

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Apache Ignite

Hive UDFs for funnel analysis

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

A simple Spark-powered ETL framework that just works 🍺

Iceberg is a table format for large, slow-moving tabular data

A simplified, lightweight ETL Framework based on Apache Spark

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Apache Parquet

💎🔥大数据学习笔记

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Mirror of Linkedin's Camus

基于wifi抓取信息的大数据查询分析系统

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

Apache Parquet

80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.

A luigi powered analytics / warehouse stack

A Spark cluster setup running on Docker containers

Example end to end data engineering project.

Cookbook to install Hadoop 2.0+ using Chef

springboot和dubbo、netty的集成，redis mongodb的nosql模板， kafka rocketmq rabbit的MQ模板， solr solrcloud elasticsearch查询引擎

Mirror of Apache Calcite - Avatica

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

Scalable, redundant, and distributed object store for Apache Hadoop

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.