517 Open source projects that are alternatives of or similar to Cluster Pack

Divolte Collector

Example project implementing best practices for PySpark ETL jobs and applications.

Create full-fledged APIs for static datasets without writing a single line of code.

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

A Container Storage Interface for S3

🔑Auth and 📦Storage for Hasura. The quickest way to get Auth and Storage working for your next app based on Hasura.

WordPress plugin to deploy static sites easily to an AWS S3 bucket.

Storage and image processing server written in Go

Synapse storage provider to fetch and store media in Amazon S3

A web based file manager,web IDE / browser based code editor

Structural Bioinformatics Training Workshop & Hackathon 2018

Minikube for big data with Scala and Spark

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

Go package for abstracting local, in-memory, and remote (Google Cloud Storage/S3) filesystems

Kafka Connect HDFS connector

Automatic backups your web projects bases and files to the clouds via WebDAV.

Directly upload files to S3 compatible services with Django.

Generic S3 server implementation

gulp plugin to publish files to amazon s3

Modularized AWS SDK for JavaScript.

关注AI模型上线、模型部署

Django + S3

Helm plugin that allows to set up a chart repository in AWS S3.

Vlad's Base Images for Docker

Measure Amazon S3's performance from any location.

This Laravel package contains additional functionality not currently in Laravel for interfacing with Amazon's S3 service (including managing versioned objects).

Tool for easy ClickHouse backup and restore with cloud storages support

A Web GUI for your S3 buckets

S3FS Docker image

EdgeFS - decentralized, scalable data fabric platform for Edge/IoT Computing and Kubernetes apps

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Real Time Analytics and Data Pipelines based on Spark Streaming

Redundant Array of Distributed Independent Objectstores in short RADIO performs synchronous mirroring, erasure coding across multiple object stores

NoDB isn't a database.. but it sort of looks like one.

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

Transcribe your audio to text with this serverless component

Scalable, redundant, and distributed object store for Apache Hadoop

Hadoop WebHDFS output plugin for Fluentd

A collection of bash shell scripts for automating various tasks with Amazon Web Services using the AWS CLI and jq.

Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time

A boilerplate for writing PySpark Jobs

Herman is a tool to simplify deployment of AWS Services using ECS and Lambda, and the provisioning of various AWS services.

WinSCP is a popular free SFTP and FTP client for Windows, a powerful file manager that will improve your productivity. It supports also Amazon S3, FTPS, SCP and WebDAV protocols. Power users can automate WinSCP using .NET assembly.

Some class materials for a data processing course using PySpark

Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks

A library that allows you to easily mock out tests based on AWS infrastructure.

Docker container to sync a folder to Amazon S3

A vue-cli plugin that uploads your built Vue.js project to an S3 bucket

An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

Amazon Simple Storage Service (S3) API Client

Like `aws s3 sync` with automatic CloudFront invalidations and more.

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

Sample using AWS Amplify and AWS AppSync together for user login and authorization when making GraphQL queries and mutations. Also includes complex objects for uploading and downloading data to and from S3 with a React app.

Parallel uploads to Amazon AWS S3

🔄 Fast and cheap synchronisation of files using Amazon S3

Punic is a remote cache CLI built for Carthage and Apple .xcframework