300 Open source projects that are alternatives of or similar to Spark-and-Kafka_IoT-Data-Processing-and-Analytics

可视化大屏解决方案, 提供一套可视化编辑引擎, 助力个人或企业轻松定制自己的可视化大屏应用.

Basic framework utilities to quickly start writing production ready Apache Spark applications

Machine Learning Course @ Santa Clara University

Apache Spark Course Material

Big Data Technology Index

pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4

学习笔记

Just a boilerplate for PySpark and Flask

tools for bigData

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…

A pure Java HDF5 library

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

Open Source Contributor Index

关注AI模型上线、模型部署

bigdata note

An Apache Spark standalone application using the Spark API in Scala. The application uses Simple Build Tool(SBT) for building the project.

a one-stop repo to lookup for code snippets of core java concepts, sql, data structures as well as big data. It also consists of interview questions asked in real-life.

No description or website provided.

Short course on interactive analysis of Big Earth Data with Jupyter Notebooks

A curated list of awesome big data frameworks, ressources and other awesomeness.

Real Time Twitter Sentiment Analysis Product

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

code, labs and lectures for the course

Масштабируемое машинное обучение и анализ больших данных с Apache Spark

A lightweight data processing framework for Apache Spark

TiDB connectors for Flink/Hive/Presto

Detect common phrases in large amounts of text using a data-driven approach. Size of discovered phrases can be arbitrary. Can be used in languages other than English

The new IoT Office Experience.

Real-world Spark pipelines examples

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

📁 Extract, Transform, Load (ETL) 👷 refers to a process in database usage and especially in data warehousing. This repository contains a starter kit featuring ETL related work.

个人笔记集中营，快糙猛的形式记录技术性Notes .. 📚☕️⌨️🎧

Collection of Databricks and Jupyter Notebooks

一道面试题的思考 - 6000万数据包和300万数据包在50M内存使用环境中求交集

Distributed least squares approximation (dlsa) implemented with Apache Spark

java学习和项目中一些典型的应用场景样例代码

Flink: Stateful Computations over Data Streams

An umbrella project for multiple implementations of model serving

The simplest tool to manage views of BigQuery.

jgit-spark-connector is a library for running scalable data retrieval pipelines that process any number of Git repositories for source code analysis.

ETL jobs for Firefox Telemetry

大数据框架 Spark MLlib 机器学习库基础算法全面讲解,附带齐全的测试文件

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

A general purpose metrics monitor implemented with Apache Spark. Kafka source, Elastic sink, aggregate metrics, different analysis, notifications, actions, live configuration update, missing metrics, ...

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

PySpark phonetic and string matching algorithms

Examples for gauravbytes.com

An open-source, cloud-ready web application for simplified deployment of big data workflows.

Make record oriented data to columnar format.

Código para workshops Spark com ambiente de desenvolvimento em docker

Generate beautiful documentation for your data pipelines in markdown format

Love your Data. Love the Environment. Love VULKИ.

Python package to manage Google Cloud Data Catalog tags, loading metadata from external sources -- currently supports the CSV file format

A connector for Apache Spark and PySpark to Dgraph databases.

A daily digest of the articles or videos I've found interesting, that I want to share with you.

Apache Spark for data engineers