2631 Open source projects that are alternatives of or similar to Amazon S3 Find And Forget

NooBaa is a Dynamic Data Gateway for cloud-native, hybrid and multi cloud environments ☁️🚀

A large-scale entity and relation database supporting aggregation of properties

Use AWS Lambda to manage SSL certificates for ACME providers like Let's Encrypt.

The code repository for the Serverless Architectures on AWS book

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

Apache Drill is a distributed MPP query layer for self describing data

📫 A serverless email server on AWS using S3 and SES

Deploy static websites in seconds - with HTTPS, a global CDN, and custom domains.

Terraform module to easily provision CloudFront CDN backed by an S3 origin

Apache Spark on AWS Lambda

👦 Lad is the best Node.js framework. Made by a former Express TC and Koa team member.

Demo of AWS S3 Walkthrough using Python

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

Deploy a secured, clustered, auto-scaling NiFi service in AWS.

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

Privacy as Code for DSAR Orchestration: Privacy Request automation to fulfill GDPR, CCPA, and LGPD data subject requests.

Flexible and efficient resize, rename, and upload images to Amazon S3 disk storage. Uses the official AWS Node SDK for transfer, and ImageMagick for image processing. Support for multiple image versions targets.

Amazon S3 input and output plugin for Fluentd

Create full-fledged APIs for static datasets without writing a single line of code.

A common framework enabling companies to work together to protect consumers' privacy and data rights.

Example Next.js app to upload photos to an S3 bucket.

Scalable, redundant, and distributed object store for Apache Hadoop

A simple mock implementation of the AWS S3 API startable as Docker image, JUnit 4 rule, or JUnit Jupiter extension

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Prowler is a security tool to perform AWS security best practices assessments, audits, incident response, continuous monitoring, hardening and forensics readiness. It contains more than 200 controls covering CIS, ISO27001, GDPR, HIPAA, SOC2, ENS and other security frameworks.

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

A library that allows you to easily mock out tests based on AWS infrastructure.

Encrypted, taggable, searchable cloud storage

🔐A small webpage library to control the execution of (third party) scripts

Directly upload files to S3 compatible services with Django.

Carthage cache for S3, Minio, Ceph, Google Storage, Artifactory and many others

Parallel S3 and local filesystem execution tool.

⚓️ GitHub webhook extension for uploading static pages to AWS S3 directly after commiting to master via Lambda written in Node.js

Check read, write permissions on S3 buckets in your account

Workshop to build a serverless tracking application for your mobile device with an AWS backend

Measure Amazon S3's performance from any location.

Code examples used in the post "How to Setup Amazon S3 in a Django Project"

Quilt is a self-organizing data hub for S3

A native Node.js producer and consumer library for Amazon Kinesis Data Streams

Seamless User Interface for replicating data into AWS.

Read and write Neuroglancer datasets programmatically.

The format of various s3 buckets is convert in one format. for bugbounty and security testing.

☁️ Amazon S3 blob-store

A collection of bash shell scripts for automating various tasks with Amazon Web Services using the AWS CLI and jq.

A collection of awesome AWS S3 tools that collects and enumerates exposed S3 buckets

Open Repository for the Open Security and Privacy Reference Architecture

Pluggable foundation blocks for building distributed apps.

[WIP] DiamonDB: Rebuild of time series database on AWS.

Udacity Data Engineering Nano Degree (DEND)

Apache Parquet

rpCheckup is an AWS resource policy security checkup tool that identifies public, external account access, intra-org account access, and private resources.

Python script for AWS resources inventory (cheaper than AWS Config)

GoAccess is a real-time web log analyzer and interactive viewer that runs in a terminal in *nix systems or through your browser.

👤 Identity and Access Management Knowledge for Cloud Platforms

🔄 GitHub Action to sync a directory with a remote S3 bucket 🧺

A command line security audit tool for Amazon Web Services

Context aware, pluggable and customizable data protection and anonymization SDK for text and images

AWS bulk tagging tool

Amazon S3 Transfer Manager for Python