462 Open source projects that are alternatives of or similar to Objinsync

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

Udacity Data Engineering Nano Degree (DEND)

Example end to end data engineering project.

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

✍️ Java 工程师必备架构体系知识总结：涵盖分布式、微服务、RPC等互联网公司常用架构，以及数据存储、缓存、搜索等必备技能

A library that allows you to easily mock out tests based on AWS infrastructure.

Sample using AWS Amplify and AWS AppSync together for user login and authorization when making GraphQL queries and mutations. Also includes complex objects for uploading and downloading data to and from S3 with a React app.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Read and write Python objects to S3, caching them on your hard drive to avoid unnecessary IO.

Carthage cache for S3, Minio, Ceph, Google Storage, Artifactory and many others

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Measure Amazon S3's performance from any location.

AWS Toolkit for Visual Studio Code, an extension for working with AWS services including AWS Lambda.

🔄 GitHub Action to sync a directory with a remote S3 bucket 🧺

Deploy website to S3/CloudFront from Python

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Reliable PostgreSQL Backup & Restore

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

An idiomatic Scala wrapper around the AWS Java SDK

A Python library that allows you to interact with Amazon S3 Buckets as if they are your local filesystem.

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

Web tool for Kafka Connect |

Helm plugin that allows to set up a chart repository in AWS S3.

A library on top of either pex or conda-pack to make your Python code easily available on a cluster

Backtest 1000s of minute-by-minute trading algorithms for training AI with automated pricing data from: IEX, Tradier and FinViz. Datasets and trading performance automatically published to S3 for building AI training datasets for teaching DNNs how to trade. Runs on Kubernetes and docker-compose. >150 million trading history rows generated from +5000 algorithms. Heads up: Yahoo's Finance API was disabled on 2019-01-03 https://developer.yahoo.com/yql/

Tool for easy ClickHouse backup and restore with cloud storages support

Parallel S3 and local filesystem execution tool.

Easy full stack backup operations on UNIX-like systems.

Elyra extends JupyterLab Notebooks with an AI centric approach.

A collection of bash shell scripts for automating various tasks with Amazon Web Services using the AWS CLI and jq.

WinSCP is a popular free SFTP and FTP client for Windows, a powerful file manager that will improve your productivity. It supports also Amazon S3, FTPS, SCP and WebDAV protocols. Power users can automate WinSCP using .NET assembly.

A series of DAGs/Workflows to help maintain the operation of Airflow

⚡️ A simple, easy way to deploy static websites to Amazon S3.

🔑Auth and 📦Storage for Hasura. The quickest way to get Auth and Storage working for your next app based on Hasura.

🦄 A modern web client for SFTP, S3, FTP, WebDAV, Git, Minio, LDAP, CalDAV, CardDAV, Mysql, Backblaze, ...

A facebook for data

VGA and BIOS rom font extraction

Modularized AWS SDK for JavaScript.

Storage and image processing server written in Go

Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/

A fake S3 server written in NodeJs

High Performance, Kubernetes Native Object Storage

gulp plugin to publish files to amazon s3

⚓️ GitHub webhook extension for uploading static pages to AWS S3 directly after commiting to master via Lambda written in Node.js

Dynamically generate Apache Airflow DAGs from YAML configuration files

A React Starter App that displays how web developers can integrate their front end with AWS on the backend. The App interacts with AWS Cognito, API Gateway, Lambda and DynamoDB on the backend.

The Infinit policy-based software-defined storage platform.

Parses AWS events payloads into a plain JavaScript object

Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.

Official s3cmd repo -- Command line tool for managing Amazon S3 and CloudFront services

EdgeFS - decentralized, scalable data fabric platform for Edge/IoT Computing and Kubernetes apps

🚎 Notebook sharing hub

Automating Your Data Pipeline with Apache Airflow

A web based file manager,web IDE / browser based code editor

NoDB isn't a database.. but it sort of looks like one.

Turbine: the bare metals that gets you Airflow

FUSE-based file system backed by Amazon S3

Access other storage backends via the S3 API