confluentinc / Kafka Connect Storage Cloud
Licence: other
Kafka Connect suite of connectors for Cloud storage (Amazon S3)
Stars: ✭ 153
Programming Languages
java
68154 projects - #9 most used programming language
Projects that are alternatives of or similar to Kafka Connect Storage Cloud
Streamx
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
Stars: ✭ 96 (-37.25%)
Mutual labels: aws, s3, kafka, kafka-connect
Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference
Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required
Stars: ✭ 204 (+33.33%)
Mutual labels: cloud, kafka, kafka-connect, confluent
Terraform Aws S3 Bucket
Terraform module which creates S3 bucket resources on AWS
Stars: ✭ 130 (-15.03%)
Mutual labels: aws, s3, aws-s3
Examples
Demo applications and code examples for Confluent Platform and Apache Kafka
Stars: ✭ 571 (+273.2%)
Mutual labels: cloud, kafka, confluent
Awesome Aws
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
Stars: ✭ 9,895 (+6367.32%)
Mutual labels: aws, cloud, s3
Cp Docker Images
[DEPRECATED] Docker images for Confluent Platform.
Stars: ✭ 975 (+537.25%)
Mutual labels: kafka, kafka-connect, confluent
Dataengineeringproject
Example end to end data engineering project.
Stars: ✭ 82 (-46.41%)
Mutual labels: s3, kafka, kafka-connect
S3 Permission Checker
Check read, write permissions on S3 buckets in your account
Stars: ✭ 18 (-88.24%)
Mutual labels: aws, s3, aws-s3
Seldon Server
Machine Learning Platform and Recommendation Engine built on Kubernetes
Stars: ✭ 1,435 (+837.91%)
Mutual labels: aws, cloud, kafka
Tweetmap
A real time Tweet Trend Map and Sentiment Analysis web application with kafka, Angular, Spring Boot, Flink, Elasticsearch, Kibana, Docker and Kubernetes deployed on the cloud
Stars: ✭ 28 (-81.7%)
Mutual labels: aws, cloud, kafka
Awslib scala
An idiomatic Scala wrapper around the AWS Java SDK
Stars: ✭ 20 (-86.93%)
Mutual labels: aws, s3, aws-s3
Nagios Plugins
450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...
Stars: ✭ 1,000 (+553.59%)
Mutual labels: aws, cloud, kafka
Touchdown
Cloud service orchestration framework for python
Stars: ✭ 10 (-93.46%)
Mutual labels: aws, cloud, aws-s3
Cloud Security Audit
A command line security audit tool for Amazon Web Services
Stars: ✭ 68 (-55.56%)
Mutual labels: aws, cloud, s3
Sbt S3 Resolver
☁️Amazon S3-based resolver for sbt
Stars: ✭ 112 (-26.8%)
Mutual labels: aws, s3, aws-s3
Kafka Connect Elasticsearch
Kafka Connect Elasticsearch connector
Stars: ✭ 550 (+259.48%)
Mutual labels: kafka, kafka-connect, confluent
Rome
Carthage cache for S3, Minio, Ceph, Google Storage, Artifactory and many others
Stars: ✭ 724 (+373.2%)
Mutual labels: aws, s3, aws-s3
Aws Workflows On Github
Workflows for automation of AWS services setup from Github CI/CD
Stars: ✭ 95 (-37.91%)
Mutual labels: aws, cloud, s3
Kafka Connect Connector for S3
kafka-connect-storage-cloud is the repository for Confluent's Kafka Connectors designed to be used to copy data from Kafka into Amazon S3.
Kafka Connect Sink Connector for Amazon Simple Storage Service (S3)
Documentation for this connector can be found here.
Blogpost for this connector can be found here.
Development
To build a development version you'll need a recent version of Kafka as well as a set of upstream Confluent projects, which you'll have to build from their appropriate snapshot branch. See the kafka-connect-storage-common FAQ for guidance on this process.
You can build kafka-connect-storage-cloud with Maven using the standard lifecycle phases.
Contribute
- Source Code: https://github.com/confluentinc/kafka-connect-storage-cloud
- Issue Tracker: https://github.com/confluentinc/kafka-connect-storage-cloud/issues
License
This project is licensed under the Confluent Community License.
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].