All Projects → saisoku → Similar Projects or Alternatives

1278 Open source projects that are alternatives of or similar to saisoku

ob bulkstash
Bulk Stash is a docker rclone service to sync, or copy, files between different storage services. For example, you can copy files either to or from a remote storage services like Amazon S3 to Google Cloud Storage, or locally from your laptop to a remote storage.
Stars: ✭ 113 (+182.5%)
Mutual labels:  sync, s3, rclone, data-pipeline
Luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Stars: ✭ 15,226 (+37965%)
Rclone
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
Stars: ✭ 30,541 (+76252.5%)
Mutual labels:  sync, s3, rclone
aws-pdf-textract-pipeline
🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
Stars: ✭ 141 (+252.5%)
Mutual labels:  s3, data-pipeline
PyFiSync
Python (+ rsync or rclone) based intelligent file sync with automatic backups and file move/delete tracking.
Stars: ✭ 88 (+120%)
Mutual labels:  sync, rclone
Docker S3 Volume
Docker container with a data volume from s3.
Stars: ✭ 166 (+315%)
Mutual labels:  sync, s3
docker base images
Vlad's Base Images for Docker
Stars: ✭ 61 (+52.5%)
Mutual labels:  sync, s3
Flinkx
Based on Apache Flink. support data synchronization/integration and streaming SQL computation.
Stars: ✭ 2,651 (+6527.5%)
docker-aws-s3-sync
Docker container to sync a folder to Amazon S3
Stars: ✭ 21 (-47.5%)
Mutual labels:  sync, s3
acid-store
A library for secure, deduplicated, transactional, and verifiable data storage
Stars: ✭ 48 (+20%)
Mutual labels:  s3, rclone
serverless-s3bucket-sync
Serverless Plugin to sync local folders with an S3 bucket
Stars: ✭ 24 (-40%)
Mutual labels:  sync, s3
mindav
A self-hosted file backup server which bridges WebDAV protocol with @minio written in @totoval. Webdav ❤️ Minio
Stars: ✭ 64 (+60%)
Mutual labels:  sync, s3
Akubra
Simple solution to keep a independent S3 storages in sync
Stars: ✭ 79 (+97.5%)
Mutual labels:  sync, s3
nifi
Deploy a secured, clustered, auto-scaling NiFi service in AWS.
Stars: ✭ 37 (-7.5%)
Mutual labels:  pipeline, s3
Cloudexplorer
Cloud Explorer
Stars: ✭ 170 (+325%)
Mutual labels:  sync, s3
Scrapy S3pipeline
Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.
Stars: ✭ 57 (+42.5%)
Mutual labels:  pipeline, s3
jobAnalytics and search
JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.
Stars: ✭ 25 (-37.5%)
Mutual labels:  s3, data-pipeline
re-mote
Re-mote operations using SSH and Re-gent
Stars: ✭ 61 (+52.5%)
Mutual labels:  pipeline, scheduling
Drone Cache
A Drone plugin for caching current workspace files between builds to reduce your build times
Stars: ✭ 194 (+385%)
Mutual labels:  pipeline, s3
minio-rclone-webdav-server
A @rclone served WebDAV server with @minio as the s3 storage backend docker example
Stars: ✭ 17 (-57.5%)
Mutual labels:  s3, rclone
rclone-drive
☁️Simple web cloud storage based on rclone, transform cloud storage (s3, google drive, one drive, dropbox) into own custom web-based storage
Stars: ✭ 30 (-25%)
Mutual labels:  s3, rclone
S4
🔄 Fast and cheap synchronisation of files using Amazon S3
Stars: ✭ 69 (+72.5%)
Mutual labels:  sync, s3
S3sync
Really fast sync tool for S3
Stars: ✭ 224 (+460%)
Mutual labels:  sync, s3
datajob
Build and deploy a serverless data pipeline on AWS with no effort.
Stars: ✭ 101 (+152.5%)
Mutual labels:  pipeline, data-pipeline
myplanet
🌕 myPlanet android app reads data from 🌎 for offline use as well as it collect usage data and sends them back to the Planet.
Stars: ✭ 17 (-57.5%)
Mutual labels:  sync
diffido
Watch web pages for changes
Stars: ✭ 19 (-52.5%)
Mutual labels:  tornado
backbeat
Zenko Backbeat is the core engine for asynchronous replication, optimized for queuing metadata updates and dispatching work to long-running tasks in the background.
Stars: ✭ 51 (+27.5%)
Mutual labels:  s3
grape-nf
An automated RNA-seq pipeline using Nextflow
Stars: ✭ 30 (-25%)
Mutual labels:  pipeline
cmakebuilder-plugin
Jenkins CMake plugin
Stars: ✭ 16 (-60%)
Mutual labels:  pipeline
HTGS
The Hybrid Task Graph Scheduler API
Stars: ✭ 36 (-10%)
Mutual labels:  pipeline
LTRpred
De novo annotation of young retrotransposons
Stars: ✭ 35 (-12.5%)
Mutual labels:  pipeline
errgroup
errgroup with goroutine worker limits
Stars: ✭ 143 (+257.5%)
Mutual labels:  sync
ckwin
C-Kermit for Windows - scriptable internet and serial communications with terminal emulation
Stars: ✭ 35 (-12.5%)
Mutual labels:  file-transfer
ClarityNLP
An NLP framework for clinical phenotyping. Docker | Python | Solr | OMOP. http://claritynlp.readthedocs.io/en/latest/
Stars: ✭ 100 (+150%)
Mutual labels:  luigi
TorrentLeechBot
A powerful telegram mirror bot..
Stars: ✭ 94 (+135%)
Mutual labels:  rclone
sync-fork
the quickest way to sync your fork: npx sync-fork
Stars: ✭ 15 (-62.5%)
Mutual labels:  sync
aws-tailor
AWS account provisioning and management service
Stars: ✭ 105 (+162.5%)
Mutual labels:  orchestration-framework
BACTpipe
BACTpipe: An assembly and annotation pipeline for bacterial genomics
Stars: ✭ 19 (-52.5%)
Mutual labels:  pipeline
skbn
Copy files and directories between Kubernetes and cloud storage
Stars: ✭ 68 (+70%)
Mutual labels:  s3
cpp-from-zero-to-one
Learning C++ from zero to one
Stars: ✭ 52 (+30%)
Mutual labels:  pipeline
mongomeili
Keep your Mongoose Schemas synced with MeiliSearch
Stars: ✭ 33 (-17.5%)
Mutual labels:  sync
lamba-thumbnailer
AWS S3 Video Thumbnailer with Lambda
Stars: ✭ 21 (-47.5%)
Mutual labels:  s3
terraform-aws-s3
Terraform module to create default S3 bucket with logging and encryption type specific features.
Stars: ✭ 22 (-45%)
Mutual labels:  s3
thingshub
[UNMAINTAINED] Synchronize issues assigned to you from a Github repo into Things.
Stars: ✭ 17 (-57.5%)
Mutual labels:  sync
gae-vue-webapp2-starter
A simple GAE Vue Webapp2 starter project.
Stars: ✭ 17 (-57.5%)
Mutual labels:  sync
Any-file-to-Google-Drive
This Google Colab notebook will help you download any file directly to Google Drive with the help of the JDownloader web interface
Stars: ✭ 47 (+17.5%)
Mutual labels:  rclone
local-cloud
Turn any computer at home into a cloud for easy sharing of files across your devices.
Stars: ✭ 70 (+75%)
Mutual labels:  transfer-files
data-transfer-hub
Seamless User Interface for replicating data into AWS.
Stars: ✭ 102 (+155%)
Mutual labels:  s3
wat
How fast are computers?
Stars: ✭ 26 (-35%)
Mutual labels:  scheduling
xp
A framework (comand line tool + libraries) for creating flexible compute pipelines
Stars: ✭ 54 (+35%)
Mutual labels:  pipeline
TensorflowDeepSortTracking
Tensorflow object detection with tracking based on the DeepSort algorithm
Stars: ✭ 60 (+50%)
Mutual labels:  pipeline
docker-volume-rclone
Use Rclone as a backend for docker volume (also as a plugin). This permit to easely mount a lot of cloud provider (https://rclone.org/overview).
Stars: ✭ 97 (+142.5%)
Mutual labels:  rclone
adonis-bundler
Blazing fast, zero configuration assets bundler for AdonisJS
Stars: ✭ 19 (-52.5%)
Mutual labels:  pipeline
pipelineRD
A chain of responsability pattern implementation in .NET that supports retry policy, sync and async steps, rollback, pipeline recovery by cache and visual documentation using diagrams.
Stars: ✭ 19 (-52.5%)
Mutual labels:  pipeline
CloudConductor
CloudConductor is a workflow management system that generates and executes bioinformatics pipelines
Stars: ✭ 13 (-67.5%)
Mutual labels:  pipeline
nestjs-storage
Nestjs file system / file storage module wrapping flydrive
Stars: ✭ 92 (+130%)
Mutual labels:  s3
TabSync
A lightweight synchronizer between Android's Tabs and Lists. Available on the View system and Jetpack Compose.
Stars: ✭ 98 (+145%)
Mutual labels:  sync
flutter aws s3 client
A simple, unofficial AWS S3 client
Stars: ✭ 24 (-40%)
Mutual labels:  s3
gawn
Genome Annotation Without Nightmares
Stars: ✭ 35 (-12.5%)
Mutual labels:  pipeline
commercetools-project-sync
Dockerized CLI application which allows to automatically sync different resources between commercetools projects
Stars: ✭ 26 (-35%)
Mutual labels:  sync
1-60 of 1278 similar projects