326 Open source projects that are alternatives of or similar to cloud-integration

Input Output Files in R from Cloud or Local

a high-performance, POSIX-ish Amazon S3 file system written in Go

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/

Real Time Twitter Sentiment Analysis Product

Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟

🌲 Access S3 like a tree.

Companion to Learning Hadoop and Learning Spark courses on Linked In Learning

MLFLow Tracking Server based on Docker and AWS S3

🔐 A concurrent, command-line AWS S3 Fuzzer. Written in Go.

Very simple CLI to create S3 / Cloudfront Static Website

Golang Clean Architecture REST API example

Spark in Action, 2nd edition - chapter 7 - Ingestion from files

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources for Academic Researchers new to AWS

A centralized repository for AI Platform notebooks using the Google Cloud Document AI API.

A file uploader written using HTML5 and Node.js. It can upload both to a local directory on the server or to an AWS S3 server.

📬 A unified file storage library for storage in cloud or on premise

A tool for deploying files to an AWS S3 bucket with configurable headers and invalidating AWS Cloudfront Objects.

A collection of Google Cloud Platform (GCP) plugins

Repository for integration with Apache Kafka

Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.

Private Composer registry for private PHP packages on AWS Serverless

Real-world Spark pipelines examples

Script to spider a website and find publicly open S3 buckets

Emacs major mode for managing jekyll

BackMeUp: An automated MySQL / MariaDB databases and files backup solution on *nix Machines using Amazon S3, WebDAV (ownCloud / NextCloud etc.), Google Drive and Dropbox.

Web app inspired by Quora, allowing users ask question and get answers

Google Cloud Storage output plugin for Fluentd.

Go version of s3cmd

BlobHelper is a common, consistent storage interface for Microsoft Azure, Amazon S3, Komodo, Kvpbase, and local filesystem written in C#.

bring sf to spark in production

[무신사 신입] 익명으로 편하게 고민, 일상을 공유하는 소셜 네트워크 서비스입니다.

Multithreaded recursive directory upload to S3 using FOG

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

A converter for the OSM PBFs to Parquet files

A lightweight file upload input for Django and Amazon S3

Old repo for R interface for GraphFrames

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

The Proxima platform.

Command line tool for S3

curated list of awesome tools and libraries for specific domains

An S3 storage adapter for Reaction Commerce's reaction-file-collections

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

[*No longer maintained*] Nexus Repository S3 Blobstores

Overlapping community detection in Large-Scale Networks using BigCLAM model build on Apache Spark

AWS S3 Video Thumbnailer with Lambda

Demo application for ostrio:files package

Big Data Management and Analysis Final Project

Simple and easy to use Flask app to upload files to Amazon S3. Based on Python, Flask, and using Boto3. Securely storing your AWS credentials as environment variables. Quick AWS S3 Flask uploader example.

Methods for the parallel and distributed analysis and mining of the Protein Data Bank using MMTF and Apache Spark.

Utilities and tools based around Amazon S3 to provide convenience APIs in a CLI

backend for a sharing app using SpringBoot, Redis, MySQL, and AWS S3.

Astronomy Broker based on Apache Spark

Official Lambda package and guide to use AWS S3 with Koel

Public reusable components for Polyaxon

A lightweight tool for analyzing the performance and data integrity of object-based storage services

Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub

Career explorer platform developed in React.js in 6 days.

Edit directly a file on Amazon S3 in CLI