sbt-avro

sbt-avro is a sbt 1.x plugin for generating Scala classes from Apache Avro schemas hosted on a remote Confluent Schema Registry.

Examples

Example of build.sbt file:

    schemaRegistryEndpoint in Avro := "http://0.0.0.0:8081",
    schemas in Avro ++= Seq(
        Schema("cc_payments-value", Version(1)),
        Schema("telecom_italia_data-value", Version(3)),
        Schema("nyc_yellow_taxi_trip_data-value", Version(1))
    )

Install

Add the plugin to your build, eg in ./project/plugins.sbt add this line:

addSbtPlugin("com.iadvize" % "sbt-avro" % "1.0.0-SNAPSHOT")

Download Avro schema files from Schema Registry

By default sbt-avro will download all Avro schema files from local schema registry to your default resources_managed directory (ie: target/scala-2.12/resources_managed/main/avro/). Please check settings section for more information about available settings.

Example:

sbt avro:download

Upload Avro schema files to Schema Registry

sbt-avro can upload all Avro Schema files from your resources directory (ie: src/main/resources/avro) to a local schema registry. Please check settings section for more information about available settings.

Example:

sbt avro:upload

Test compatibility of schemas with their latest versions in Schema Registry

sbt-avro can test schemas for compatibility against the latest version of a subject's schema. This makes use of the Schema Registry compatibility resource.

The plugin will look for *.avsc files in :

• Resources folder (ie: src/main/resources/avro/)
• Resources Managed folder (ie: target/scala-2.12/resources_managed/main/avro/)

Example:

sbt avro:compatibility

Generate scala classes from Avro schema files

The plugin sbt-avro will look for *.avsc files in :

• Resources folder (ie: src/main/resources/avro/)
• Resources Managed folder (ie: target/scala-2.12/resources_managed/main/avro/)

Important : If a duplicate avro schema (same name ) is detected in your resources folder and in your resources_managed folder, the compiler will compile only the schema in resources folder. So, for example, in dev if you want to try some local changes, you can duplicate your schema from your resources managed folder into your resources folder and compile your changes.

So put your schema files there and run:

sbt avro:generate

The case classes will get generated in your default src_managed directory (ie:target/scala-2.12/src_managed/main/avro/).

Documentation

Settings

Tasks

Important: sbt:compile task will only call avro:generate and not call download task.

Custom Templates

You can use your custom templates to generate scala source from Avro schema. If you want to use custom templates, please add your custom templates into $templateDirectory folder. Template example:

#if ($schema.getNamespace())
package $schema.getNamespace()
#end

#if ($schema.getDoc())
/** $schema.getDoc() */
#end
object ${this.mangle($schema.getName())} extends Enumeration {

  val Schema = "${this.javaEscape($schema.toString())}"

  val #foreach ($symbol in ${schema.getEnumSymbols()})${this.mangle($symbol)}#if ($velocityHasNext), #end#end = Value

}

Contribute

Look at contribution guidelines here : CONTRIBUTING.md

Contributors

• Victor Pirat
• Jocelyn Dréan
• Ian Duffy