RatatoolA tool for data sampling, data generation, and data diffing
Stars: ✭ 279 (+389.47%)
Devops Python Tools80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
Stars: ✭ 406 (+612.28%)
DaFlowApache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.
Stars: ✭ 24 (-57.89%)
Bigdata File ViewerA cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.
Stars: ✭ 86 (+50.88%)
Schema RegistryConfluent Schema Registry for Kafka
Stars: ✭ 1,647 (+2789.47%)
Vscode Data PreviewData Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files
Stars: ✭ 245 (+329.82%)
Bigdata PlaygroundA complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Stars: ✭ 177 (+210.53%)
Rumble⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more
Stars: ✭ 58 (+1.75%)
RqRecord Query - A tool for doing record analysis and transformation
Stars: ✭ 1,808 (+3071.93%)
parquet-extraA collection of Apache Parquet add-on modules
Stars: ✭ 30 (-47.37%)
SchemerSchema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.
Stars: ✭ 97 (+70.18%)
columnifyMake record oriented data to columnar format.
Stars: ✭ 28 (-50.88%)
ChoetlETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
Stars: ✭ 372 (+552.63%)
Jackson Dataformats BinaryUber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile
Stars: ✭ 221 (+287.72%)
IcebergIceberg is a table format for large, slow-moving tabular data
Stars: ✭ 393 (+589.47%)
Cpp SerializersBenchmark comparing various data serialization libraries (thrift, protobuf etc.) for C++
Stars: ✭ 533 (+835.09%)
Enif protobufA Google Protobuf implementation with enif (Erlang nif).
Stars: ✭ 33 (-42.11%)
Ethereum EtlPython scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Stars: ✭ 956 (+1577.19%)
Openfaas GkeRunning OpenFaaS on Google Kubernetes Engine
Stars: ✭ 30 (-47.37%)
Docs ExamplesOpen in Cloud Shell Examples for the Google provider docs
Stars: ✭ 50 (-12.28%)
Go CloudThe Go Cloud Development Kit (Go CDK): A library and tools for open cloud development in Go.
Stars: ✭ 8,124 (+14152.63%)
AvrocadoAvrocado is a convenience library to handle Avro in Golang
Stars: ✭ 21 (-63.16%)
ProtobufGo support for Google's protocol buffers
Stars: ✭ 8,111 (+14129.82%)
Csi GcsKubernetes CSI driver for Google Cloud Storage
Stars: ✭ 44 (-22.81%)
Meteor Google CloudAutomate Meteor deployments on Google Cloud App Engine Flexible
Stars: ✭ 32 (-43.86%)
Kubernetes GuidesCrosswalk Playbooks and Code for Teams to Manage Kubernetes in Production
Stars: ✭ 51 (-10.53%)
PbparserGolang library for parsing protocol buffer (.proto) files
Stars: ✭ 30 (-47.37%)
PucketBucketing and partitioning system for Parquet
Stars: ✭ 29 (-49.12%)
HayatHayat is a script for report and analyze Google Cloud Platform resources.
Stars: ✭ 55 (-3.51%)
Tensorflow Java ClientExample of Java/Scala grpc client for tensorflow_serving (https://github.com/tensorflow/serving)
Stars: ✭ 20 (-64.91%)
Georide Positionget the last day deplacement of the georide tracker
Stars: ✭ 15 (-73.68%)
PgoapiUnofficial PokemonGO API in Python
Stars: ✭ 874 (+1433.33%)
Proto ExtractorProgram to extract protobufs compiled for C#
Stars: ✭ 49 (-14.04%)
FastapiFastAPI Tutorials & Deployment Methods to Cloud and on prem infrastructures
Stars: ✭ 41 (-28.07%)
GrpcAn Elixir implementation of gRPC
Stars: ✭ 858 (+1405.26%)
QuiltQuilt is a self-organizing data hub for S3
Stars: ✭ 1,007 (+1666.67%)
CloudguardiaasCheck Point CloudGuard Network Security repository containing solution templates, Terraform templates, tools and scripts for deploying and configuring CloudGuard Network Security products.
Stars: ✭ 27 (-52.63%)
Meme GeneratorMemeGen is a web application where the user gives an image as input and our tool generates a meme at one click for the user.
Stars: ✭ 57 (+0%)
GrpccA gRPC cli interface for easy testing against gRPC servers
Stars: ✭ 1,078 (+1791.23%)
JabciJava implementation of the Tendermint ABCI
Stars: ✭ 48 (-15.79%)
Sol2protoEthereum contract ABI to gRPC protobuf IDL transpiler
Stars: ✭ 41 (-28.07%)
AvscAvro for JavaScript ⚡️
Stars: ✭ 930 (+1531.58%)
Datashare ToolkitDIY commercial datasets on Google Cloud Platform
Stars: ✭ 41 (-28.07%)
Protobuf SwiftGoogle ProtocolBuffers for Apple Swift
Stars: ✭ 925 (+1522.81%)
Node ParquetNodeJS module to access apache parquet format files
Stars: ✭ 46 (-19.3%)
Lua ProtobufA Lua module to work with Google protobuf
Stars: ✭ 1,002 (+1657.89%)
Rpc ThunderdomeA comparison between Proteus RPC and other commonly used RPC frameworks
Stars: ✭ 22 (-61.4%)
Grpc ContractA tool to generate the grpc server code for a contract
Stars: ✭ 40 (-29.82%)
FsfirestoreFunctional F# library to access Firestore database hosted on Google Cloud Platform (GCP) or Firebase.
Stars: ✭ 22 (-61.4%)