928 Open source projects that are alternatives of or similar to Bigslice

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

AWS Auto Terminate Idle AWS EMR Clusters Framework is an AWS based solution using AWS CloudWatch and AWS Lambda using a Python script that is using Boto3 to terminate AWS EMR clusters that have been idle for a specified period of time.

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

C# and F# language binding and extensions to Apache Spark

Big Data for Data Engineers Coursera Specialization from Yandex

Python clone of Spark, a MapReduce alike framework in Python

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

大数据采集,抽取平台

大数据生态圈学习

Detect threats with log data and improve cloud security posture

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualize and explore big tabular data at a billion rows per second 🚀

Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.

Масштабируемое машинное обучение и анализ больших данных с Apache Spark

大数据学习笔记，学习路线，技术案例整理。

大数据入门指南 ⭐

网站点击流离线日志分析

An open source platform for managing and analyzing biomedical big data

Next generation API for .NET

An HPC workload manager and job scheduler for desktops, clusters, and clouds.

Power of appbase.io via CLI, with nifty imports from your favorite data sources

TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.

A simple python OCR engine using opencv

The open and extensible integrated development environment (IDE) for computer vision with built-in modules for model building, automated labeling, data processing, model training, hyperparameter tuning and workflow orchestration.

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

A repository for the source code, notebooks, data, files, and other assets used in the data science and machine learning articles on LearnDataSci

A global Process Registry and Process Group manager for Erlang and Elixir.

Multiple implementations for abstractive text summurization , using google colab

C# Server UNISTACK framework [MOVED]

d3 library to build circular graphs

A self-hosted, open-source Platform as a Service that enables easy swarm deployments, load balancing, automatic SSL, metrics, analytics and more.

Logical Replication extension for PostgreSQL 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

The experimentation and testing tool for Apache Mesos - NO LONGER MAINTANED!

AIStore: scalable storage for AI applications

Extract, Transform, Load: Any SQL Database in 4 lines of Code.

High Performance HTTP Sidecar Load Balancer

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

A simplified, lightweight ETL Framework based on Apache Spark

Akka.NET professional reference code samples

A HTTP Ruby API for Consul

VictoriaMetrics: fast, cost-effective monitoring solution and time series database

Jigsaw七巧板 provides a set of web components based on Angular5/8/9+. The main purpose of Jigsaw is to help the application developers to construct complex & intensive interacting & user friendly web pages. Jigsaw is supporting the development of all applications of Big Data Product of ZTE.

Starter Kit for Node.js v14.x, minimum dependencies 🚀

SmartCode = IDataSource -> IBuildTask -> IOutput => Build Everything!!!

A lightweight library that provides group member discovery, status dissemination, and failure detection using the SWIM epidemic protocol.

Run Kubernetes locally

custom human activity recognition modules by pose estimation and cascaded inference using sklearn API

DataWave is an ingest/query framework that leverages Apache Accumulo to provide fast, secure data access.

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

一个大数据架构师应该掌握的技能

kubemci: Command line tool to configure L7 load balancers using multiple kubernetes clusters

Qubole Sparklens tool for performance tuning Apache Spark

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Port of Akka actors for .NET

RSS as RESTful. This service allows you to transform RSS feed into an awesome API.

基于web版kettle开发的一套分布式综合调度,管理,ETL开发的用户专业版B/S架构工具

A tool for creating multi-node Kubernetes clusters on a Linux machine using kubeadm & systemd-nspawn. Brought to you by the Kinvolk team.

This repository is a collection of resources to prepare for the Certified Kubernetes Security Specialist (CKSS) exam.

distributed Actors for Java 8 / JavaScript

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.