GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → mmolimar → kafka-connect-fs

mmolimar / kafka-connect-fs

Licence: Apache-2.0 license
Kafka Connect FileSystem Connector

Programming Languages

java
68154 projects - #9 most used programming language
COBOL
34 projects

Labels

fileskafkahadoopfilesystemftps3gcpconfluenthdfskafka-connectapache-kafkaazure-storagekafka-connectorhadoop-filesystemkafka-connect-fs

Projects that are alternatives of or similar to kafka-connect-fs

Kafka Connect Hdfs
Kafka Connect HDFS connector
Stars: ✭ 400 (+273.83%)
Mutual labels:  hadoop, confluent, hdfs, apache-kafka
Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference
Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required
Stars: ✭ 204 (+90.65%)
Mutual labels:  gcp, confluent, kafka-connect
Kafka Connect Ui
Web tool for Kafka Connect |
Stars: ✭ 388 (+262.62%)
Mutual labels:  s3, hdfs, kafka-connect
Kafka Connect Storage Cloud
Kafka Connect suite of connectors for Cloud storage (Amazon S3)
Stars: ✭ 153 (+42.99%)
Mutual labels:  s3, confluent, kafka-connect
kafka-connect-iot-mqtt-connector-example
Internet of Things Integration Example => Apache Kafka + Kafka Connect + MQTT Connector + Sensor Data
Stars: ✭ 170 (+58.88%)
Mutual labels:  confluent, kafka-connect, kafka-connector
datasqueeze
Hadoop utility to compact small files
Stars: ✭ 18 (-83.18%)
Mutual labels:  hadoop, hdfs, hadoop-filesystem
Streamx
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
Stars: ✭ 96 (-10.28%)
Mutual labels:  s3, gcp, kafka-connect
Juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Stars: ✭ 4,262 (+3883.18%)
Mutual labels:  filesystem, s3, hdfs
HDFS-Netdisc
基于Hadoop的分布式云存储系统 🌴
Stars: ✭ 56 (-47.66%)
Mutual labels:  hadoop, hdfs, hadoop-filesystem
Goofys
a high-performance, POSIX-ish Amazon S3 file system written in Go
Stars: ✭ 3,932 (+3574.77%)
Mutual labels:  filesystem, s3, azure-storage
Devops Python Tools
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
Stars: ✭ 406 (+279.44%)
Mutual labels:  hadoop, gcp, hdfs
Camus
Mirror of Linkedin's Camus
Stars: ✭ 81 (-24.3%)
Mutual labels:  hadoop, confluent, hdfs
replace-in-files
Replace text in one or more files or globs.
Stars: ✭ 21 (-80.37%)
Mutual labels:  files, filesystem
files
Useful methods to manage files and directories
Stars: ✭ 27 (-74.77%)
Mutual labels:  files, filesystem
Zeus
🔭 A modern cross platform `ls` with powerful searching and querying capabilities to scale your productivity to the moon 🚀 (and yeah it has file explorer like capabilities too 🤫)
Stars: ✭ 75 (-29.91%)
Mutual labels:  files, filesystem
Chonky
😸 A File Browser component for React.
Stars: ✭ 313 (+192.52%)
Mutual labels:  files, filesystem
nucked-truth-of-files
HollyJS Moscow
Stars: ✭ 14 (-86.92%)
Mutual labels:  files, filesystem
Python Atomicwrites
Powerful Python library for atomic file writes.
Stars: ✭ 253 (+136.45%)
Mutual labels:  files, filesystem
Filegator
Powerful Multi-User File Manager
Stars: ✭ 587 (+448.6%)
Mutual labels:  files, filesystem
Memacs
What did I do on February 14th 2007? Visualize your (digital) life in Org-mode
Stars: ✭ 711 (+564.49%)
Mutual labels:  files, filesystem
View All Similar Projects ➔

Kafka Connect FileSystem Connector Build StatusCoverage Status

kafka-connect-fs is a Kafka Connector for reading records from files in the file systems specified and load them into Kafka.

Documentation for this connector can be found here.

Development

To build a development version you'll need a recent version of Kafka. You can build kafka-connect-fs with Maven using the standard lifecycle phases.

FAQ

Some frequently asked questions on Kafka Connect FileSystem Connector can be found here - https://kafka-connect-fs.readthedocs.io/en/latest/faq.html

Contribute

License

Released under the Apache License, version 2.0.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].