707 Open source projects that are alternatives of or similar to Data Ingestion Platform

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

When Apache Pulsar meets Apache Spark

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

Next generation tool for decentralized exchange and transformation of semi-structured data

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

A Scala feature transformation library for data science and machine learning

StreamLine - Streaming Analytics

Schema Registry

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&Flink 等

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

Elastic data processing with Apache Pulsar and Apache Flink

Spark、Flink等离线任务的调度以及实时任务的监控

Java开发者或者大数据开发者面试知识点整理

大数据入门指南 ⭐

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

Production Ready Data Integration Product, documentation：

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Streaming System 相关的论文读物

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Code and presentation for Strata Model Serving tutorial

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

深圳地铁大数据客流分析系统🚇🚄🌟

Feature engineering toolkit for Spark MLlib.

Jupyter magics and kernels for working with remote Spark clusters

Development REST API for InterSystems Caché 2014.1+

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

A Lightning Component grid implementation that expects a server-side data store.

Bucketing and partitioning system for Parquet

A heterogeneous Apache Spark framework.

MapReduce, Spark, Java, and Scala for Data Algorithms Book

Distributed Stream and Batch Processing

Salesforce Utility

A big data platform for analyzing web access logs

Vagrant projects for various use-cases with Spark, Zeppelin, IPython / Jupyter, SparkR

Real-time analysis and visualization with Storm-AMQ-Camel-Websockets-Highcharts integration.

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

HEDA Affiliation-Based Security for Salesforce

Browser extension for Salesforce logs management

Chain Batches in a readable and flexible way without hardcoding the successor.

Distributed, fault tolerant batch processing for Natural Language Applications and Search, using remote partitioning

SendGrid (http://sendgrid.com) Apex helper library.

A real time Tweet Trend Map and Sentiment Analysis web application with kafka, Angular, Spring Boot, Flink, Elasticsearch, Kibana, Docker and Kubernetes deployed on the cloud

Efficient variant-call data storage and retrieval library using the TileDB storage library.

Computes and visualizes the sentiment analysis of tweets of US States in real-time using Storm.

High performance HBase / Spark SQL engine

Builder Extension library to fflib_apex-common

Spark (http://sparkjava.com/) support for Swagger (https://swagger.io/)

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

零基础学习spark，大数据学习