450 Open source projects that are alternatives of or similar to Aztk

Boiler plate framework to use Spark and ZIO together.

📊 Cube — Open-Source Analytics API for Building Data Apps

An encrypted data analytics platform

There are pieces of scala code that explain Scala syntax and related things - like what you can do with all this

Distributed Deep learning with Keras & Spark

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Spark Streaming监控平台，支持任务部署与告警、自启动

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Azure Function for a URL shortening website. Uses serverless functions, Azure Table Storage and Application Insights.

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

☀️ World Cleanup Day: App (React Native) & Platform (Node). Join us in building software for a cleaner planet! PRs welcome!

Apache Spark on AWS Lambda

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

Geospatial Raster support for Spark DataFrames

Apache Spark and Apache Kafka integration example

Elassandra = Elasticsearch + Apache Cassandra

DataStax Spark Cassandra Connector

Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Data science and Big Data with Python

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

Production Ready Data Integration Product, documentation：

🌿 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、spring-batch、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等📌

Collaborate on privacy-preserving policy for data science projects in Pandas and Apache Spark

Two-day workshop that covers how to use R to interact databases and Spark

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

A Spark SQL extension which provides SQL Standard Authorization for Apache Spark

This package contains a generic implementation of greedy Information Theoretic Feature Selection (FS) methods. The implementation is based on the common theoretic framework presented by Gavin Brown. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided.

Node.js bindings for Apache Spark DataFrame APIs

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

Pandas and Spark DataFrame comparison for humans

pyspark🍒🥭 is delicious，just eat it!😋😋

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Azure Storage transfer tool and data movement library

A repository to keep track of all the code that I end up writing for my blog posts.

Kinesis Connector for Structured Streaming

Avro SerDe for Apache Spark structured APIs.

A pandas-like deferred expression system, with first-class SQL support

Process Common Crawl data with Python and Spark

Spark RDD with Lucene's query and entity linkage capabilities

Jupyter kernel for scala and spark

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

Microsoft Azure Blob Storage integration for Laravel's Storage API

extremely distributed machine learning

A large-scale entity and relation database supporting aggregation of properties

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

汇总java生态圈常用技术框架、开源中间件，系统架构、数据库、大公司架构案例、常用三方类库、项目管理、线上问题排查、个人成长、思考等知识

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

Feature Store for Machine Learning

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&Flink 等

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

A robust, and flexible open source User & Entity Behavior Analytics (UEBA) framework used for Security Analytics. Developed with luv by Data Scientists & Security Analysts from the Cyber Security Industry. [PRE-ALPHA]

Fundamentals of Spark with Python (using PySpark), code examples

Updated repository

Fast, Scientific and Numerical Computing for the JVM (NDArrays)

A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.

The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.