401 Open source projects that are alternatives of or similar to optimus

🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)

Foofah: programming-by-example data transformation program synthesizer

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

A library for managing, validating, summarizing, and visualizing data.

Anovos - An Open Source Library for Scalable feature engineering Using Apache-Spark

🤖 A machine learning framework for audio, text, image, video, or .CSV files (50+ featurizers and 15+ model trainers).

Visualize and compare datasets, target values and associations, with one line of code.

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

Create HTML profiling reports from pandas DataFrame objects

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

Wrangler Transform: A DMD system for transforming Big Data

Repository for the projects needed to complete the Data Analyst Nanodegree.

The JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

bamboolib - template for creating your own binder notebook

Some class materials for a data processing course using PySpark

Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time

🐳 big data study

Asynchronous HBase client for NodeJs using REST

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

TipDM建模平台，开源的数据挖掘工具。

bigdatatutorial

懒松鼠Flink-Boot 脚手架让Flink全面拥抱Spring生态体系，使得开发者可以以Java WEB开发模式开发出分布式运行的流处理程序，懒松鼠让跨界变得更加简单。懒松鼠旨在让开发者以更底上手成本（不需要理解分布式计算的理论知识和Flink框架的细节）便可以快速编写业务代码实现。为了进一步提升开发者使用懒松鼠脚手架开发大型项目的敏捷的度，该脚手架默认集成Spring框架进行Bean管理，同时将微服务以及WEB开发领域中经常用到的框架集成进来，进一步提升开发速度。比如集成Mybatis ORM框架，Hibernate Validator校验框架,Spring Retry重试框架等，具体见下面的脚手架特性。

Sort files and pack them into partitions

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

An easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.

An open-source big data platform designed and optimized for the Internet of Things (IoT).

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

A connector for Apache Spark and PySpark to Dgraph databases.

Monitor twitter stream

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Monitor the stability of a Pandas or Spark dataframe ⚙︎

A Cloud Native Batch System (Project under CNCF)

An end-to-end machine learning and data mining framework on Hadoop

머신러닝/딥러닝(PyTorch, TensorFlow) 전용 도커입니다. 한글 폰트, 한글 자연어처리 패키지(konlpy), 형태소 분석기, Timezone 등의 설정 등을 추가 하였습니다.

liteflow是一个基于任务版本来实现的分布式任务流调度系统

Java开发者或者大数据开发者面试知识点整理

Distributed Big Data Orchestration Service

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

实践源码库：https://github.com/jast90/bigdata 。 微信搜索Jast关注公众号，获取最新技术分享😯。

技术书籍等

基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法

A generic framework for simplifying the creation of linked data.

An open-source, cloud-ready web application for simplified deployment of big data workflows.

A daily digest of the articles or videos I've found interesting, that I want to share with you.

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

🌲 Configuration flaws detector for Hadoop, MongoDB, MySQL, and more!

Based on Apache Flink. support data synchronization/integration and streaming SQL computation.

A curated list of awesome big data frameworks, ressources and other awesomeness.

Ultimate Tennis Statistics and Tennis Crystal Ball - Tennis Big Data Analysis and Prediction

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

大数据分析可视化实践

GridDB is a next-generation open source database that makes time series IoT and big data fast,and easy.

flink学习笔记

☕️ Java 基础 👫 面向对象思想✏️ 算法 📝 操作系统 ☁️ 网络 💾 数据库 🙊 Spring 💡 系统架构🐘大数据

Source code for James Lee's Aparch Spark with Java course

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange