407 Open source projects that are alternatives of or similar to Datashim

EdgeFS - decentralized, scalable data fabric platform for Edge/IoT Computing and Kubernetes apps

Terraform module designed to easily backup EFS filesystems to S3 using DataPipeline

The LeoFS Storage System

A curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.

The Infinit policy-based software-defined storage platform.

Docker NFS, AWS EFS, Ceph & Samba/CIFS Volume Plugin

Cyberduck is a libre FTP, SFTP, WebDAV, Amazon S3, Backblaze B2, Microsoft Azure & OneDrive and OpenStack Swift file transfer client for Mac and Windows.

Continuously synchronize directories from remote object store to local filesystem

Parses AWS events payloads into a plain JavaScript object

A Multi-Master Distributed Caching Layer for Amazon S3.

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

⚓️ GitHub webhook extension for uploading static pages to AWS S3 directly after commiting to master via Lambda written in Node.js

Code examples used in the post "How to Setup Amazon S3 in a Django Project"

This module creates an S3 bucket suitable for receiving logs from other AWS services such as S3, CloudFront, and CloudTrail

Scala client for Amazon S3

Amazon S3 bucket spelunking!

Workshop to build a serverless tracking application for your mobile device with an AWS backend

The format of various s3 buckets is convert in one format. for bugbounty and security testing.

Deploy website to S3/CloudFront from Python

Python interface to the TileDB storage manager

Check read, write permissions on S3 buckets in your account

Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.

WinSCP is a popular free SFTP and FTP client for Windows, a powerful file manager that will improve your productivity. It supports also Amazon S3, FTPS, SCP and WebDAV protocols. Power users can automate WinSCP using .NET assembly.

🔑Auth and 📦Storage for Hasura. The quickest way to get Auth and Storage working for your next app based on Hasura.

Painless iOS over-the-air enterprise distribution

The Universal Storage Engine

Modularized AWS SDK for JavaScript.

Automatically unburden $HOME from caches, etc. Useful for $HOME on SSDs, small disks or slow NFS homes. Can be triggered via an hook in /etc/X11/Xsession.d/.

Deploy create react app's in AWS S3

Seamless User Interface for replicating data into AWS.

locopy: Loading/Unloading to Redshift and Snowflake using Python.

MinIO Client SDK for Haskell

Read and write Neuroglancer datasets programmatically.

Static site uploader for Amazon S3

Simple solution to keep a independent S3 storages in sync

Access other storage backends via the S3 API

Undocumented Amazon S3 APIs and third-party extensions

An idiomatic Scala wrapper around the AWS Java SDK

Python script for AWS resources inventory (cheaper than AWS Config)

Optimize a static website for hosting in S3, by including a fingerprint into all assets' filenames. The optimized website is uploaded into the specified S3 bucket with the right cache headers.

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

Read and write Python objects to S3, caching them on your hard drive to avoid unnecessary IO.

Google Apps Script that publishes a Google Sheet to Amazon S3 as a JSON file. Auto-updates on edit & maintains data types. Creates an array of objects keyed by column header.

A library on top of either pex or conda-pack to make your Python code easily available on a cluster

STUPS' Docker registry with S3 backend, immutable tags and SCM source tracking

AWS Toolkit for Visual Studio Code, an extension for working with AWS services including AWS Lambda.

A command line security audit tool for Amazon Web Services

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

📎 Flexible file upload and attachment library for Elixir

Reliable PostgreSQL Backup & Restore

🔦 Motion detecting security camera using a raspberry pi, webcam, and slack

Carthage cache for S3, Minio, Ceph, Google Storage, Artifactory and many others

Docker images and scripts to deploy to AWS

High Performance, Kubernetes Native Object Storage

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

Swift wrapper around AWS API

Chai (https://chaijs.com) and Jest (https://jestjs.io/) assertions for testing services built with aws

A React Starter App that displays how web developers can integrate their front end with AWS on the backend. The App interacts with AWS Cognito, API Gateway, Lambda and DynamoDB on the backend.

Backtest 1000s of minute-by-minute trading algorithms for training AI with automated pricing data from: IEX, Tradier and FinViz. Datasets and trading performance automatically published to S3 for building AI training datasets for teaching DNNs how to trade. Runs on Kubernetes and docker-compose. >150 million trading history rows generated from +5000 algorithms. Heads up: Yahoo's Finance API was disabled on 2019-01-03 https://developer.yahoo.com/yql/

Lambda functions over S3 objects with concurrency control (each, map, reduce, filter)