1493 Open source projects that are alternatives of or similar to Addax

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。

python ETL framework

🚀 零代码、热更新、全自动 ORM 库，后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构。 🚀 A JSON Transmission Protocol and an ORM Library for automatically providing APIs and Docs.

The CSV to database command line loader

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

jOOQ is the best way to write SQL in Java

Big Data Toolkit for the JVM

同步Hive数据仓库数据到Elasticsearch的小工具

🦄 .NET orm, Mysql orm, Postgresql orm, SqlServer orm, Oracle orm, Sqlite orm, Firebird orm, 达梦 orm, 人大金仓 orm, 神通 orm, 翰高 orm, 南大通用 orm, Click house orm, MsAccess orm.

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

a set of scripts to pull meta data and data profiling metrics from relational database systems

Linq to database provider.

SymmetricDS is a database and file synchronization solution that is platform-independent, web-enabled, and database agnostic. SymmetricDS was built to make data replication across two to tens of thousands of databases and file systems fast, easy and resilient. We specialize in near real time, bi-directional data replication across large node networks over the WAN or LAN.

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.

分表分库的新思路——服务层Sharding框架，全SQL、全数据库兼容，ACID特性与原生数据库一致，能实现RR级别读写分离，无SQL解析性能更高

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

网站点击流离线日志分析

Liquibase extension to add Impala Database support

Main Liquibase Source

深圳地铁大数据客流分析系统🚇🚄🌟

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

The official home of the Presto distributed SQL query engine for big data

Big Data Ecosystem Docker

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Open Source HTTP Reverse Proxy Cache and Time Series Dashboard Accelerator

Facebook's Hive UDFs

A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.

Hive JDBC "uber" or "standalone" jar based on the latest Apache Hive version

A client for connecting and running DDLs on hive metastore.

大数据学习笔记，学习路线，技术案例整理。

Smart Automation Tool for building modern Data Lakes and Data Pipelines

Hive Storage Handler for interoperability between BigQuery and Apache Hive

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

Connectors simplify connecting to standalone and CloudFoundry services

Open-source distribute workflow schedule tools, also support streaming task.

Fense is a database proxy written in Java, which can connect DB of different engines at the same time. The key features are: authority management, query cache, audit security, current limiting fuse, onesql and so on

Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

大数据入门指南 ⭐

基于DataX的通用数据同步微服务，一个Restful接口搞定所有通用数据同步

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

Example projects for 'BigInsights for Apache Hadoop' on IBM Bluemix

SQL Server Management Studio 2018 Productivity Tool

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

A .NET class library that allows you to import data from different sources into a unified destination

Terraform module to deploy Cloudera on Oracle Cloud Infrastructure (OCI)

Open Source HTTP Reverse Proxy Cache and Time Series Dashboard Accelerator

SQL backend to dplyr for Impala

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

一个对用户行为日志进行分析的大数据项目

OLAP and ETL of Big Data

An alternative to the "hive standalone" jar for connecting Java applications to Apache Hive via JDBC

Entity-Relationship diagram code generator library

Import data from clickhouse to hadoop with pure SQL