All Projects → nodefluent → schema-registry

nodefluent / schema-registry

Licence: MIT license
📙 json & avro http schema registry backed by Kafka

Programming Languages

javascript
184084 projects - #8 most used programming language
shell
77523 projects

Projects that are alternatives of or similar to schema-registry

avro turf
A library that makes it easier to use the Avro serialization format from Ruby.
Stars: ✭ 130 (+465.22%)
Mutual labels:  schema, avro, schema-registry
Schema Registry
Confluent Schema Registry for Kafka
Stars: ✭ 1,647 (+7060.87%)
Mutual labels:  schema, avro, schema-registry
sbt-avro
Plugin SBT to Generate Scala classes from Apache Avro schemas hosted on a remote Confluent Schema Registry.
Stars: ✭ 15 (-34.78%)
Mutual labels:  schema, avro, schema-registry
srclient
Golang Client for Schema Registry
Stars: ✭ 188 (+717.39%)
Mutual labels:  registry, schema, avro
confluent-spark-avro
Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.
Stars: ✭ 18 (-21.74%)
Mutual labels:  avro, schema-registry
spring-cloud-stream-event-sourcing-testcontainers
Goal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an event informing this change is sent to Kafka. Also, we will implement another application that listens to those events and saves them in Cassandra. Finally, we will use Testcontainers for integration testing.
Stars: ✭ 16 (-30.43%)
Mutual labels:  avro, schema-registry
Insulator
A client UI to inspect Kafka topics, consume, produce and much more
Stars: ✭ 53 (+130.43%)
Mutual labels:  schema, avro
Kaufmann ex
Kafka backed service library.
Stars: ✭ 86 (+273.91%)
Mutual labels:  schema, avro
Schema Registry
A CLI and Go client for Kafka Schema Registry
Stars: ✭ 105 (+356.52%)
Mutual labels:  schema, avro
kafka-scala-examples
Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala
Stars: ✭ 53 (+130.43%)
Mutual labels:  avro, schema-registry
pulsar-io-kafka
Pulsar IO Kafka Connector
Stars: ✭ 24 (+4.35%)
Mutual labels:  schema, schema-registry
dotnet-avro
An Avro implementation for .NET
Stars: ✭ 60 (+160.87%)
Mutual labels:  avro, schema-registry
avrora
A convenient Elixir library to work with Avro schemas and Confluent® Schema Registry
Stars: ✭ 59 (+156.52%)
Mutual labels:  avro, schema-registry
avro ex
An Avro Library that emphasizes testability and ease of use.
Stars: ✭ 47 (+104.35%)
Mutual labels:  schema, avro
schema-registry-php-client
A PHP 7.3+ API client for the Confluent Schema Registry REST API based on Guzzle 6 - http://docs.confluent.io/current/schema-registry/docs/index.html
Stars: ✭ 40 (+73.91%)
Mutual labels:  avro, schema-registry
avrow
Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.
Stars: ✭ 27 (+17.39%)
Mutual labels:  schema, avro
tamer
Standalone alternatives to Kafka Connect Connectors
Stars: ✭ 42 (+82.61%)
Mutual labels:  avro, schema-registry
NoSE
👃 Automated schema design for NoSQL applications
Stars: ✭ 25 (+8.7%)
Mutual labels:  schema
open-api-mocker
A mock server based in OpenAPI Specification
Stars: ✭ 58 (+152.17%)
Mutual labels:  schema
faker-schema
Generate fake data using joke2k's faker and your own schema
Stars: ✭ 91 (+295.65%)
Mutual labels:  schema

node-schema-registry

Greenkeeper badge

Build Status

DISCLAIMER: We encourage you to keep your topics dynamic and JSON only, when choosing to go the Node.js Kafka way. Therefore we are no longer adding features to this registry project. When you are looking for a typed (schema-requirement) approach we suggest using Confluent's schema-registry with AVRO.

  • in BETA 🌱
  • avro & json schema registry backed by Kafka 🐙
  • API similar to confluentinc's schema-registry
  • enhances the experience of node-kafka-streams
  • enables node-kafka-connect
  • might also be used in a Kafka unrelated field
  • ships with a neat RegistryClient
  • checkout API Quickstart
  • compatibility options are currently disabled
  • LivingAvroSchema and LivingJsonSchema allow for real-time schema updates in running services

What is a Schema Registry?

Schema Registry provides a serving layer for your metadata. It provides a RESTful interface for storing and retrieving Avro schemas. It stores a versioned history of all schemas, provides multiple compatibility settings and allows evolution of schemas according to the configured compatibility setting. It provides serializers that plug into Kafka clients that handle schema storage and retrieval for Kafka messages that are sent in the Avro format.

Code Wise (Dev)

npm install --save schema-registry
const {RegistryClient, Registry, LivingAvroSchema} = require("schema-registry");
const registryClient = new RegistryClient({port: 1337});
registryClient.getLatestSubjectSchema("test-subject").then(schema => {..});

Living Schemas

const {LivingAvroSchema} = require("schema-registry");
const livingSchema = new LivingAvroSchema("test", "latest", {port: 1337});
livingSchema.on("new-version", console.log);
livingSchema.fetch().then(_ => {
    const buffer = livingSchema.toBuffer(someObject);
    const equalToSomeObject = livingSchema.fromBuffer(buffer);
});

Run a Registry (Ops) (Quicksetup)

npm install -g schema-registry
# you will need zookeeper + kafka (checkout `/kafka-setup/start.sh`
# if you dont have them)
# node-schema-registry -h
node-schema-registry -p 1337 -z localhost:2181/ -t _node_schema -l info

Using the registry CLI Client

nsrc --host localhost -p 1337 -e getSchemaById -a e707463d-0c3d-4010-afed-0d53c77e3605 -v
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].