1202 Open source projects that are alternatives of or similar to Data-pipeline-project

Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

A light-weight distributed stream computing framework for Golang

An easy way to deploy your Akka services to a distributed environment.

Bulk Stash is a docker rclone service to sync, or copy, files between different storage services. For example, you can copy files either to or from a remote storage services like Amazon S3 to Google Cloud Storage, or locally from your laptop to a remote storage.

网站点击流离线日志分析

Admin Spring Boot Locally

💎🔥大数据学习笔记

Mapreduce project by Hadoop, Nutch, AWS EMR, Pig, Tez, Hive

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

MapReduce, Spark, Java, and Scala for Data Algorithms Book

Asakusa Framework

大数据学习笔记，学习路线，技术案例整理。

A tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.

大数据入门指南 ⭐

大数据生态圈学习

Powerful CLI tool to simplify Amazon ECS deployments, rollbacks & scaling

Serverless Data Pipeline powered by Kinesis Firehose, API Gateway, Lambda, S3, and Athena

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

A tool and library for easily deploying applications on Apache YARN

Cascading is a feature rich API for defining and executing complex and fault tolerant data processing flows locally or on a cluster. See https://github.com/Cascading/cascading for the release repository.

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

gomrjob - a Go Framework for Hadoop Map Reduce Jobs

Companion to Learning Hadoop and Learning Spark courses on Linked In Learning

A Pharo Tool to package applications

A simple Maven plugin to make your build byte-for-byte reproducible

a one-stop repo to lookup for code snippets of core java concepts, sql, data structures as well as big data. It also consists of interview questions asked in real-life.

Apache Maven Shade Plugin

Lifecycle management for the Microsoft Visual C++ Redistributables

Deploy your React app to production on Netlify, Vercel and Heroku

基于ssm的入门项目，图书在线管理系统。a library system.

Sample Projects for Creating Springs Web services in Scala

practice project，Helps with QT software deployment on Windows

Deploying ROS apps using Docker

同步Hive数据仓库数据到Elasticsearch的小工具

用于检测maven项目的第三方依赖组件是否存在安全漏洞。

λ A selfhostable serverless function runtime. Inspired by zeit now.

Information Inference Service of the OpenAIRE system

Extension for the WorldGuard plugin.

基于Hadoop的分布式云存储系统 🌴

command line tool for uploading directory of maven artifacts to nexus 3.x repository

The simplest machine learning library for launching UIs, running evaluations, and comparing model performance.

Amazon Selling Partner JAVA SDK SP API

Hive Storage Handler for interoperability between BigQuery and Apache Hive

Maven plugin for ktlint the Kotlin linter

Base scaffolding app for a casperjs/phantomjs app running on Amazon (AWS) Lambda

Erlang Parse Transforms Including Fold (MapReduce) comprehension, Elixir-like Pipeline, and default function arguments

Pipeline module for parallel real-time data processing for machine learning models development and production purposes.

🍉基于Hadoop和HBase的大规模海量数据去重

大学生信息管理系统——初学路上自己摸索实践的项目

Primrose modeling framework for simple production models

Simple tool to dockerize and manage deployment of your project

A decision tree to help you decide on the right AWS compute service for your needs.

Continuous Delivery for Java Apps: Build a CD Pipeline Step by Step Using Kubernetes, Docker, Vagrant, Jenkins, Spring, Maven and Artifactory

Maven Repository Manager Concourse Resource

Spring Boot脚手架工程

A Terraform module to create a Route53 Domain Name System (DNS) on Amazon Web Services (AWS). https://aws.amazon.com/route53/

Atguigu-SSM-CRUD 一个最基本的CRUD系统，采用IDEA+Maven搭建，具备前后端交互功能，前端采用BootStrap+Ajax异步请求DOM渲染，后端采用SpringMVC+MyBatis+Mysql8.0+Servlet+Jsp，符合REST风格URL规范，并加入了Hibernate提供的数据校验功能，支持PageHelper的分页功能，很适合SSM阶段性练习。同时用到了很多前端操作以及BootStrap组件，也有利于学习JS和前端框架。