2264 Open source projects that are alternatives of or similar to Kafka Connect Storage Cloud

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

Check read, write permissions on S3 buckets in your account

Demo applications and code examples for Confluent Platform and Apache Kafka

Amazon S3 Transfer Manager for Python

AWS bulk tagging tool

[DEPRECATED] Docker images for Confluent Platform.

Machine Learning Platform and Recommendation Engine built on Kubernetes

☁️Amazon S3-based resolver for sbt

A simple mock implementation of the AWS S3 API startable as Docker image, JUnit 4 rule, or JUnit Jupiter extension

Carthage cache for S3, Minio, Ceph, Google Storage, Artifactory and many others

Terraform module which creates S3 bucket resources on AWS

Workflows for automation of AWS services setup from Github CI/CD

Serverless Platform for the stateful services

Flexible and efficient resize, rename, and upload images to Amazon S3 disk storage. Uses the official AWS Node SDK for transfer, and ImageMagick for image processing. Support for multiple image versions targets.

⚡️ A simple, easy way to deploy static websites to Amazon S3.

Amazon Simple Storage Service (S3) API Client

🔄 GitHub Action to sync a directory with a remote S3 bucket 🧺

A real time Tweet Trend Map and Sentiment Analysis web application with kafka, Angular, Spring Boot, Flink, Elasticsearch, Kibana, Docker and Kubernetes deployed on the cloud

Kafka Connect FileSystem Connector

Ansible playbooks for the Confluent Platform

Kafka Connect Elasticsearch connector

Web tool for Kafka Connect |

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

Scala client for Amazon S3

A command line security audit tool for Amazon Web Services

Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

An idiomatic Scala wrapper around the AWS Java SDK

Cloud service orchestration framework for python

Example end to end data engineering project.

📫 A serverless email server on AWS using S3 and SES

A DSL for data-driven computational pipelines

CLI experience for Frontend developers in the JavaScript ecosystem.

Scan for open AWS S3 buckets and dump the contents

Cloud Security Posture Management (CSPM)

List of resources - courses, sample code, articles and screencasts for learning AWS, Azure, GCP and Alibaba Cloud

[WIP] DiamonDB: Rebuild of time series database on AWS.

💪 Extended MulterModule for NestJS with flexible S3 upload and helpful features

Resource-adaptive cluster scheduler for deep learning training.

rpCheckup is an AWS resource policy security checkup tool that identifies public, external account access, intra-org account access, and private resources.

Curated list of awesome cloud security blogs, podcasts, standards, projects, and examples.

Pluggable foundation blocks for building distributed apps.

equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨

A CLI and Go client for Kafka Schema Registry

Mist is an open source, multi-cloud management platform

AWS Lambda image processor

A Pi Zero and Motion based webcamera that forwards images to Amazon Web Services for Image Processing

Support for running Microsoft's Playwright on AWS Lambda and Google Cloud Functions

ansible based multicloud orchestrator

A minimalistic UI to conveniently upload and download files from AWS S3

Confluent Schema Registry for Kafka

MinIO Client is a replacement for ls, cp, mkdir, diff and rsync commands for filesystems and object storage.

🚀 direct-to-S3 uploading using ClojureScript

A REPL for Apache Kafka

☁️ Go API for open cloud

➿ 💡 My Udacity projects that I have made to improve my skills and complete my nanodegree. Please don't use it to copy the projects. Submit the PR if you want something to be added to this repository.

Kafka Connect Tooling

Basic logging mechanism for Node 6.10+ Lambda Functions

AWS Lambda serverless blogging platform