323 Open source projects that are alternatives of or similar to Hadoop Connectors

Hive Storage Handler for interoperability between BigQuery and Apache Hive

An example mini data warehouse for python project stats, template for new projects

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Apache Drill is a distributed MPP query layer for self describing data

A large-scale entity and relation database supporting aggregation of properties

Big Data Ecosystem Docker

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

Hive JDBC "uber" or "standalone" jar based on the latest Apache Hive version

Apache Hadoop

Asakusa Framework

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

Ephemeral Hadoop clusters using Google Compute Platform

Automated feature engineering for geospatial data

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

The official home of the Presto distributed SQL query engine for big data

Load data from Kafka to any data warehouse

An end-to-end machine learning and data mining framework on Hadoop

📊 Cube — Open-Source Analytics API for Building Data Apps

Mirror of Apache Hadoop HDFS

Go package to read and write parquet files. parquet is a file format to store nested data structures in a flat columnar data format. It can be used in the Hadoop ecosystem and with tools such as Presto and AWS Athena.

Quix Notebook Manager

Big Data Toolkit for the JVM

Production Ready Data Integration Product, documentation：

Stream data into Google BigQuery concurrently using InsertAll()

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

Mirror of Apache Calcite - Avatica

实践源码库：https://github.com/jast90/bigdata 。 微信搜索Jast关注公众号，获取最新技术分享😯。

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Spark、Flink等离线任务的调度以及实时任务的监控

Griffon Data Science Virtual Machine

Open source Business Intelligence tool 🎉

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

a bot that generates realistic replies using a combination of pretrained GPT-2 and BERT models

Universalizando o acesso a dados no Brasil. Docs: https://basedosdados.github.io/mais/

Apache Nutch is an extensible and scalable web crawler

Common solutions and tools developed by Google Cloud's Professional Services team

Mirror of Apache Hadoop common

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

Apache Calcite

A pandas-like deferred expression system, with first-class SQL support

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

Google BigQuery Datasource Plugin for Grafana.

Support TensorFlow on YARN

Fundamentals of Spark with Python (using PySpark), code examples

extremely distributed machine learning

Java开发者或者大数据开发者面试知识点整理

🐘 Source code for assignments of Udacity course "Introduction to Hadoop and MapReduce"

Apache Parquet implementation in Rust

80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.

A Scala API for Apache Beam and Google Cloud Dataflow.

GCP Variant Transforms

AI on Hadoop

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Facebook's Hive UDFs

推荐项目（实时推荐和离线推荐）

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL