mdmlang
Data transformation language that makes the process of mapping data easier and with a natural syntax. The grammar for this DSL is based on Antlr4.
Available Operations
There is some operations that you are able to use (some variations allowed, please check the grammar file):
- keep only numbers of
field - trim
field - remove leading zeros from
field - remove 3 chars from left of
field - substring 2 to 3 of
field - truncate at 20
field - return
field
Usage Example
source-data.json
{
"it-codigo": " my item ",
"desc-item": " large description that contains more than 20 chars ",
"num-ddd": 47,
"num-telefone": "number 9000-1000"
}mdmlang-rules.txt
itemCode:
trim it-codigo
return it-codigo
description:
trim desc-item
truncate at 20 desc-item
return desc-item
phoneNumber:
trim num-telefone
keep only numbers of num-telefone
return num-ddd and num-telefone
Java App:
import java.io.IOException;
import java.io.InputStream;
import java.io.InputStreamReader;
import java.lang.reflect.Type;
import java.util.Map;
import com.google.gson.Gson;
import com.google.gson.reflect.TypeToken;
import org.brunocvcunha.mdmlang.processor.MDMProcessorContext;
public class MDMLanguageMain {
public static void main(String[] args) throws IOException {
Gson gson = new Gson();
InputStream rules = MDMLanguageMain.class.getResourceAsStream("/mdmlang-rules.txt");
InputStream json = MDMLanguageMain.class.getResourceAsStream("/source-data.json");
MDMProcessorContext ctx = MDMProcessorContext.buildContext(rules);
Type type = new TypeToken<Map<String, Object>>() {}.getType();
Map<String, Object> values = gson.fromJson(new InputStreamReader(json), type);
Map<String, Object> golden = ctx.process(values);
System.out.println(gson.toJson(golden));
}
}Outputs Transformed Data:
{
"itemCode": "my item",
"description": "large description th",
"phoneNumber": "4790001000"
}Download
(Release still on process)
Download the latest JAR or grab via Maven:
<dependency>
<groupId>org.brunocvcunha.mdmlang</groupId>
<artifactId>mdmlang</artifactId>
<version>1.0</version>
</dependency>or Gradle:
compile 'org.brunocvcunha.mdmlang:mdmlang:1.0'Snapshots of the development version are available in Sonatype's snapshots repository.
MDM Lang requires at minimum Java 7.