flask-fsSimple and easy file storages for Flask
Stars: ✭ 30 (+20%)
Airflow PipelineAn Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
Stars: ✭ 128 (+412%)
check-engineData validation library for PySpark 3.0.0
Stars: ✭ 29 (+16%)
jobs-to-mailYour personal job-search assistant
Stars: ✭ 92 (+268%)
BlobHelperBlobHelper is a common, consistent storage interface for Microsoft Azure, Amazon S3, Komodo, Kvpbase, and local filesystem written in C#.
Stars: ✭ 23 (-8%)
backup-repositoryBackup storage for E2E GPG-encrypted files, with multi-user, quotas, versioning, using a object storage (S3/Min.io/GCS etc.) and deployed on Kubernetes or standalone.
Stars: ✭ 21 (-16%)
Afctlafctl helps to manage and deploy Apache Airflow projects faster and smoother.
Stars: ✭ 116 (+364%)
flask-driveA simple Flask app to upload and download files off Amazon's S3
Stars: ✭ 23 (-8%)
Dive-Into-AWSLinks to the Repos and Sections in our Dive into AWS Course.
Stars: ✭ 27 (+8%)
DataspherestudioDataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
Stars: ✭ 1,195 (+4680%)
DiscreetlyETLy is an add-on dashboard service on top of Apache Airflow.
Stars: ✭ 60 (+140%)
go-storageA vendor-neutral storage library for Golang: Write once, run on every storage service.
Stars: ✭ 387 (+1448%)
XeneA distributed workflow runner focusing on performance and simplicity.
Stars: ✭ 56 (+124%)
Argo WorkflowsWorkflow engine for Kubernetes
Stars: ✭ 10,024 (+39996%)
herd-mdlHerd-MDL, a turnkey managed data lake in the cloud. See https://finraos.github.io/herd-mdl/ for more information.
Stars: ✭ 11 (-56%)
AmazonSimple access to Amazon's web services.
Stars: ✭ 20 (-20%)
backup-suiteBackup database, static files and config to AWS S3 with Cronjob
Stars: ✭ 32 (+28%)
etl[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library
Stars: ✭ 279 (+1016%)
Docker AirflowRepo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/
Stars: ✭ 29 (+16%)
ElyraElyra extends JupyterLab Notebooks with an AI centric approach.
Stars: ✭ 839 (+3256%)
terraform-aws-cloudtrailTerraform module to provision an AWS CloudTrail and an encrypted S3 bucket with versioning to store CloudTrail logs
Stars: ✭ 78 (+212%)
qsvCSVs sliced, diced & analyzed.
Stars: ✭ 438 (+1652%)
s3-monitoringNo description or website provided.
Stars: ✭ 14 (-44%)
Agile data code 2Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
Stars: ✭ 413 (+1552%)
datartDatart is a next generation Data Visualization Open Platform
Stars: ✭ 1,042 (+4068%)
firehoserA wrapper around AWS Kinesis Firehose with retry logic and custom queuing behavior. Requires node >= 6.0.0
Stars: ✭ 22 (-12%)
awesome-storageA curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.
Stars: ✭ 324 (+1196%)
qscamelqscamel is a command line tool to migrate data between different endpoint efficiently.
Stars: ✭ 34 (+36%)
muxfysHigh performance multiplexed user fuse mounting
Stars: ✭ 20 (-20%)
terraform-aws-efs-backupTerraform module designed to easily backup EFS filesystems to S3 using DataPipeline
Stars: ✭ 40 (+60%)
helpdeskYet another helpdesk based on multiple providers
Stars: ✭ 14 (-44%)
nifiDeploy a secured, clustered, auto-scaling NiFi service in AWS.
Stars: ✭ 37 (+48%)
sls-photos-upload-serviceExample web app and serverless API for uploading photos and saving to S3 and DynamoDB
Stars: ✭ 50 (+100%)
s3-exampleSimple example using micro for uploading stuff to AWS S3.
Stars: ✭ 45 (+80%)
airflow-code-editorA plugin for Apache Airflow that allows you to edit DAGs in browser
Stars: ✭ 195 (+680%)
prefect-saturnPython client for using Prefect Cloud with Saturn Cloud
Stars: ✭ 15 (-40%)
fss3FSS3 is an S3 filesystem abstraction layer for Golang
Stars: ✭ 52 (+108%)
hubPublic reusable components for Polyaxon
Stars: ✭ 8 (-68%)
Bucket-FlawsBucket Flaws ( S3 Bucket Mass Scanner ): A Simple Lightweight Script to Check for Common S3 Bucket Misconfigurations
Stars: ✭ 43 (+72%)
dbt-sugardbt-sugar is a CLI tool that allows users of dbt to have fun and ease performing actions around dbt models
Stars: ✭ 139 (+456%)
magento-s3Use Amazon S3 as the file storage solution for your Magento store
Stars: ✭ 62 (+148%)
Insight-GDELT-FeedA way for home buyers to know about factors affecting a state
Stars: ✭ 43 (+72%)
uptasticsearchAn Elasticsearch client tailored to data science workflows.
Stars: ✭ 47 (+88%)
ndstorecode for storing neurodata images and image annotations
Stars: ✭ 39 (+56%)