1784 Open source projects that are alternatives of or similar to Parquet4s

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

Library for reading and writing csv-files in Qt.

Apache Parquet implementation in Rust

550+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Kafka, Docker, APIs, Hadoop, SQL, PostgreSQL, MySQL, Hive, Impala, Travis CI, Jenkins, Concourse, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, .tmux.conf, .psqlrc ...

Microservice for safe sharing and easy access to medical images

提供清晰、实用的Akka应用指导

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

Examples and explanations of how Akka toolkit works

Iceberg is a table format for large, slow-moving tabular data

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

A large-scale entity and relation database supporting aggregation of properties

Lightweight api management on top of a modern http reverse proxy

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

🎥 MP4 reader and writer library in Rust! 🦀

A Go package for reading & writing messages in maildir format

A distributed fake data generator based in Akka.

A simple tool to read/write Mifare RFID tags with an ACR122U device

A library for editing PE files with full .NET metadata support

Read and write spreadsheet files (CSV, XLSX and ODS), in a fast and scalable way

An easy way to deploy your Akka services to a distributed environment.

A resilient and scalable shopping cart system designed using Event Sourcing (ES) and Command Query Responsibility Segregation (CQRS)

Another example of a REST API with Akka HTTP

XML without worries

Ruby API client framework

IOStreams is an incredibly powerful streaming library that makes changes to file formats, compression, encryption, or storage mechanism transparent to the application.

Ini file reader/writer for C# / .NET written in pure .NET in a single source file

Big Data Toolkit for the JVM

open files for buffered reading and writing in #golang

Add-ons to Akka Stream

IRC-style chat demo featuring full-stack F#, Akka.Streams, Akkling, Fable, Elmish, Websockets and .NET Core

Optimized bit-level Reader and Writer for Go.

Diagram- and graph-generating library for Akka Streams

Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

Akka Streams example of how to interleave Sources with priorities

Quark is a streaming-first Api Gateway using Akka

Read and write java class files in Node.js or in the browser.

Functional Telegram Bot API wrapper for Scala on top of akka, circe, cats, and shapeless

Package iobit provides primitives for reading & writing bits

Example projects building Reactive Integrations using Alpakka

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

phData Pulse application log aggregation and monitoring

Framework for building distributed microserviceies in scala with akka-streams and kafka

Go package to read and write parquet files. parquet is a file format to store nested data structures in a flat columnar data format. It can be used in the Hadoop ecosystem and with tools such as Presto and AWS Athena.

Demos of how to do custom stream processing using the Akka Streams GraphStages API

Apache Drill is a distributed MPP query layer for self describing data

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Akka HTTP REST API Project Template using Akka HTTP 10.0.4 with Circe 0.7.0 targeting Scala 2.12.x

Akka Stream library for Azure IoT Hub

Akka Streams & Akka HTTP for Large-Scale Production Deployments

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

An AWS AppSync Serverless resolver for the Amazon Aurora relational database.

Visual Studio Code extension that provides commands to deploy files of a workspace to a destination.

Security Remediation Guides

Deploying a Strapi API on AWS (EC2 & RDS & S3)

The simplest, most powerful way to build serverless applications

The modern serverless web application engine and framework for Swift

SlideHub is an Open Source Slide Sharing Application for Azure / AWS

Awsaml is an application for providing automatically rotated temporary AWS credentials.