Vscode Data PreviewData Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files
StoragetapperStorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service
Mu HaskellMu (μ) is a purely functional framework for building micro services.
KafkactlCommand Line Tool for managing Apache Kafka
Bigdata PlaygroundA complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Gradle Avro PluginA Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.
AvroApache Avro is a data serialization system.
Aptos☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats
NoprotoFlexible, Fast & Compact Serialization with RPC
Kafka Connect Mongodb**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
RqRecord Query - A tool for doing record analysis and transformation
AbrisAvro SerDe for Apache Spark structured APIs.
SlimmessagebusLightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
KebsScala library to eliminate boilerplate
Avro Hadoop StarterExample MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.
SchemerSchema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
MagnolifyA collection of Magnolia add-on modules
Avro4kAvro support for kotlinx.serialization
Bigdata File ViewerA cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.
Open Bank MarkA bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.
Rumble⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more
Gcs ToolsGCS support for avro-tools, parquet-tools and protobuf
ExamplesDemo applications and code examples for Confluent Platform and Apache Kafka
Go Kafka AvroA library provides consumer/producer to work with kafka, avro and schema registry
AvrocadoAvrocado is a convenience library to handle Avro in Golang
AvscAvro for JavaScript ⚡️
Aptos☀️ Avro, Protobuf, Thrift on Swagger
Kafka Storm StarterCode examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
Pmacctpmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].
Avro4sAvro schema generation and serialization / deserialization for Scala
Cpp SerializersBenchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++
Devops Python Tools80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
IcebergIceberg is a table format for large, slow-moving tabular data
ChoetlETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
RatatoolA tool for data sampling, data generation, and data diffing
qweryA SQL-like language for performing ETL transformations.
spring-cloud-stream-event-sourcing-testcontainersGoal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an event informing this change is sent to Kafka. Also, we will implement another application that listens to those events and saves them in Cassandra. Finally, we will use Testcontainers for integration testing.
avroraA convenient Elixir library to work with Avro schemas and Confluent® Schema Registry
InsulatorA client UI to inspect Kafka topics, consume, produce and much more
goavroGoavro translates between Go native types and binary and textual Avro data
avro exAn Avro Library that emphasizes testability and ease of use.