2754 Open source projects that are alternatives of or similar to Streamx

Kafka Connect suite of connectors for Cloud storage (Amazon S3)

Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.

Example end to end data engineering project.

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

550+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Kafka, Docker, APIs, Hadoop, SQL, PostgreSQL, MySQL, Hive, Impala, Travis CI, Jenkins, Concourse, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, .tmux.conf, .psqlrc ...

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

Open-Source Web GUI for Apache Kafka Management

Machine Learning Platform and Recommendation Engine built on Kubernetes

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Kafka Connect FileSystem Connector

Web tool for Kafka Connect |

Kafka Connect HDFS connector

🚀 direct-to-S3 uploading using ClojureScript

Offensive Terraform Website

Check Point CloudGuard Network Security repository containing solution templates, Terraform templates, tools and scripts for deploying and configuring CloudGuard Network Security products.

A real time Tweet Trend Map and Sentiment Analysis web application with kafka, Angular, Spring Boot, Flink, Elasticsearch, Kibana, Docker and Kubernetes deployed on the cloud

Distributed Stream and Batch Processing

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

Cloud Security Posture Management (CSPM)

The Go Cloud Development Kit (Go CDK): A library and tools for open cloud development in Go.

Demo applications and code examples for Confluent Platform and Apache Kafka

Crosswalk Playbooks and Code for Teams to Manage Kubernetes in Production

cloudquery transforms your cloud infrastructure into SQL or Graph database for easy monitoring, governance and security.

Scala client for Amazon S3

Chai (https://chaijs.com) and Jest (https://jestjs.io/) assertions for testing services built with aws

Fast, multi-purpose tool for AWS CloudWatch Logs

Infrastructure, containers, and serverless apps to AWS, Azure, GCP, and Kubernetes... all deployed with Pulumi

Workflows for automation of AWS services setup from Github CI/CD

⚓️ GitHub webhook extension for uploading static pages to AWS S3 directly after commiting to master via Lambda written in Node.js

Deploy website to S3/CloudFront from Python

Kafka connect Elastic sink connector, with just in time index/delete behaviour.

Workshop to build a serverless tracking application for your mobile device with an AWS backend

An idiomatic Scala wrapper around the AWS Java SDK

[DEPRECATED] Docker images for Confluent Platform.

Kafka Connect Elasticsearch Source

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

Seamless User Interface for replicating data into AWS.

Code examples used in the post "How to Setup Amazon S3 in a Django Project"

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

Scan for open AWS S3 buckets and dump the contents

Docker images and scripts to deploy to AWS

A native Node.js producer and consumer library for Amazon Kinesis Data Streams

DevOps Toolkit for Every Cloud on Every Cloud

Ansible playbook to deploy distributed technologies

The format of various s3 buckets is convert in one format. for bugbounty and security testing.

Read and write Neuroglancer datasets programmatically.

Deploy create react app's in AWS S3

Kattlo CLI Project

This module creates an S3 bucket suitable for receiving logs from other AWS services such as S3, CloudFront, and CloudTrail

☁️ Amazon S3 blob-store

A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.

A command line security audit tool for Amazon Web Services

Runtime configuration loader extensible with providers

locopy: Loading/Unloading to Redshift and Snowflake using Python.

Pulumi - Developer-First Infrastructure as Code. Your Cloud, Your Language, Your Way 🚀

Swift wrapper around AWS API

Python script for AWS resources inventory (cheaper than AWS Config)

rpCheckup is an AWS resource policy security checkup tool that identifies public, external account access, intra-org account access, and private resources.