avro-serde-phpAvro Serialisation/Deserialisation (SerDe) library for PHP 7.3+ & 8.0 with a Symfony Serializer integration
Stars: ✭ 43 (+138.89%)
Open Bank MarkA bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.
Stars: ✭ 81 (+350%)
ExamplesDemo applications and code examples for Confluent Platform and Apache Kafka
Stars: ✭ 571 (+3072.22%)
Schema RegistryA CLI and Go client for Kafka Schema Registry
Stars: ✭ 105 (+483.33%)
confluent-spark-avroSpark UDFs to deserialize Avro messages with schemas stored in Schema Registry.
Stars: ✭ 18 (+0%)
srclientGolang Client for Schema Registry
Stars: ✭ 188 (+944.44%)
avroraA convenient Elixir library to work with Avro schemas and Confluent® Schema Registry
Stars: ✭ 59 (+227.78%)
schema-registry-php-clientA PHP 7.3+ API client for the Confluent Schema Registry REST API based on Guzzle 6 - http://docs.confluent.io/current/schema-registry/docs/index.html
Stars: ✭ 40 (+122.22%)
StoragetapperStorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service
Stars: ✭ 232 (+1188.89%)
Mu HaskellMu (μ) is a purely functional framework for building micro services.
Stars: ✭ 215 (+1094.44%)
Avro4kAvro support for kotlinx.serialization
Stars: ✭ 82 (+355.56%)
Avro Hadoop StarterExample MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.
Stars: ✭ 110 (+511.11%)
MagnolifyA collection of Magnolia add-on modules
Stars: ✭ 81 (+350%)
Bigdata File ViewerA cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.
Stars: ✭ 86 (+377.78%)
Bigdata PlaygroundA complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Stars: ✭ 177 (+883.33%)
Rumble⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more
Stars: ✭ 58 (+222.22%)
Dcos MetricsThe metrics pipeline for DC/OS 1.9-1.11
Stars: ✭ 57 (+216.67%)
parquet-extraA collection of Apache Parquet add-on modules
Stars: ✭ 30 (+66.67%)
kafka-scala-examplesExamples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala
Stars: ✭ 53 (+194.44%)
Mongo KafkaMongoDB Kafka Connector
Stars: ✭ 166 (+822.22%)
Go Kafka AvroA library provides consumer/producer to work with kafka, avro and schema registry
Stars: ✭ 39 (+116.67%)
AvscAvro for JavaScript ⚡️
Stars: ✭ 930 (+5066.67%)
Aptos☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats
Stars: ✭ 144 (+700%)
Kafka Storm StarterCode examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
Stars: ✭ 728 (+3944.44%)
KebsScala library to eliminate boilerplate
Stars: ✭ 113 (+527.78%)
Vscode Data PreviewData Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files
Stars: ✭ 245 (+1261.11%)
Avro4sAvro schema generation and serialization / deserialization for Scala
Stars: ✭ 593 (+3194.44%)
SchemerSchema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
Stars: ✭ 97 (+438.89%)
Jackson Dataformats BinaryUber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile
Stars: ✭ 221 (+1127.78%)
Kaufmann exKafka backed service library.
Stars: ✭ 86 (+377.78%)
Cpp SerializersBenchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++
Stars: ✭ 533 (+2861.11%)
Kafka Connect Mongodb**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
Stars: ✭ 137 (+661.11%)
Devops Python Tools80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
Stars: ✭ 406 (+2155.56%)
KafkactlCommand Line Tool for managing Apache Kafka
Stars: ✭ 177 (+883.33%)
Avro BuilderRuby DSL to create Avro schemas
Stars: ✭ 82 (+355.56%)
kafkaESKAn event-driven monitoring tool that can consume messages from Apache Kafka clusters and display the aggregated data on a dashboard for analysis and maintenance.
Stars: ✭ 79 (+338.89%)
Gcs ToolsGCS support for avro-tools, parquet-tools and protobuf
Stars: ✭ 57 (+216.67%)
Gradle Avro PluginA Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.
Stars: ✭ 176 (+877.78%)
singlestore-logistics-simScalable package delivery logistics simulator built using SingleStore and Vectorized Redpanda
Stars: ✭ 31 (+72.22%)
AvrocadoAvrocado is a convenience library to handle Avro in Golang
Stars: ✭ 21 (+16.67%)
AvroApache Avro is a data serialization system.
Stars: ✭ 2,005 (+11038.89%)
Aptos☀️ Avro, Protobuf, Thrift on Swagger
Stars: ✭ 17 (-5.56%)
sbt-avroPlugin SBT to Generate Scala classes from Apache Avro schemas hosted on a remote Confluent Schema Registry.
Stars: ✭ 15 (-16.67%)
Pmacctpmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].
Stars: ✭ 677 (+3661.11%)
NoprotoFlexible, Fast & Compact Serialization with RPC
Stars: ✭ 138 (+666.67%)
puppet-confluentPuppet Module for installing and configuring the Confluent Platform
Stars: ✭ 14 (-22.22%)
ChoetlETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
Stars: ✭ 372 (+1966.67%)
IcebergIceberg is a table format for large, slow-moving tabular data
Stars: ✭ 393 (+2083.33%)
RqRecord Query - A tool for doing record analysis and transformation
Stars: ✭ 1,808 (+9944.44%)
AvroA fast Go Avro codec
Stars: ✭ 132 (+633.33%)
RatatoolA tool for data sampling, data generation, and data diffing
Stars: ✭ 279 (+1450%)
tamerStandalone alternatives to Kafka Connect Connectors
Stars: ✭ 42 (+133.33%)
avrowAvrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.
Stars: ✭ 27 (+50%)
fast-avro-writeWriting an Avro file is not as fast as you might want it. This is a library to write considerably faster to an avro file.
Stars: ✭ 32 (+77.78%)
AbrisAvro SerDe for Apache Spark structured APIs.
Stars: ✭ 130 (+622.22%)