300 Open source projects that are alternatives of or similar to Spark-and-Kafka_IoT-Data-Processing-and-Analytics

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

bigdatatutorial

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

C# and F# language binding and extensions to Apache Spark

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

大数据生态圈学习

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Updated repository

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Counting Tweets Per User in Real-Time

Plot live-stats as graph from ApacheSpark application using Lightning-viz

Anovos - An Open Source Library for Scalable feature engineering Using Apache-Spark

Some class materials for a data processing course using PySpark

Documentation placeholder and utilities for all the other containers.

Workspace for China local user group.

Simple and Distributed Machine Learning

Exposure是一个帮助做曝光统计需求的库，可以很方便的对曝光事件进行埋点，在现有代码上少量侵入即可实现曝光埋点。支持RV的线性布局、网格布局、瀑布流布局、横向滑动RV，ScrollView等各种滚动布局。支持配置item的有效曝光面积。

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

Design/Implement stream/batch architecture on NYC taxi data | #DE

Native Julia I/O package to work with CERN ROOT files

Data syncing in golang for ClickHouse.

an open source dataworks platform

Ppts, códigos y videos de las meetups, data science days, videollamadas y workshops. Data Science Research es una organización sin fines de lucro que busca difundir, descentralizar y difundir los conocimientos en Ciencia de Datos e Inteligencia Artificial en el Perú, dando oportunidades a nuevos talentos mediante MeetUps, Workshops y Semilleros …

JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook

Data validation library for PySpark 3.0.0

可视化大屏解决方案, 提供一套可视化编辑引擎, 助力个人或企业轻松定制自己的可视化大屏应用.

Basic framework utilities to quickly start writing production ready Apache Spark applications

学习笔记

tools for bigData

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

关注AI模型上线、模型部署

An Apache Spark standalone application using the Spark API in Scala. The application uses Simple Build Tool(SBT) for building the project.

No description or website provided.

A curated list of awesome big data frameworks, ressources and other awesomeness.

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

code, labs and lectures for the course

A lightweight data processing framework for Apache Spark

The new IoT Office Experience.

An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset

Detect common phrases in large amounts of text using a data-driven approach. Size of discovered phrases can be arbitrary. Can be used in languages other than English

用Python爬取安居客房源信息，并用高德地图进行可视化

Boilerplate for PySpark on Cloud Kubernetes

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

📁 Extract, Transform, Load (ETL) 👷 refers to a process in database usage and especially in data warehousing. This repository contains a starter kit featuring ETL related work.

Learning Flink : Flink CEP,Flink Core,Flink SQL

Collection of Databricks and Jupyter Notebooks

Distributed least squares approximation (dlsa) implemented with Apache Spark

Taller SparkR para las Jornadas de Usuarios de R

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

Flink: Stateful Computations over Data Streams

The simplest tool to manage views of BigQuery.

Tidy up Spark and Hadoop tutorials.

ETL jobs for Firefox Telemetry

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

Machine Learning Course @ Santa Clara University

Apache Spark Course Material

Big Data Technology Index