1113 Open source projects that are alternatives of or similar to Parquet Generator

Spark SQL index for Parquet tables

Apache Spark - A unified analytics engine for large-scale data processing

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

A large-scale entity and relation database supporting aggregation of properties

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

Create full-fledged APIs for static datasets without writing a single line of code.

Code examples for my blog posts

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

Apache Spark Website

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

Next generation tool for decentralized exchange and transformation of semi-structured data

Bucketing and partitioning system for Parquet

Optimized Analytics Package for Spark* Platform

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

A simplified, lightweight ETL Framework based on Apache Spark

Unified SQL Analytics Engine Based on SparkSQL

Kyuubi is a unified multi-tenant JDBC interface for large-scale data processing and analytics, built on top of Apache Spark

Fundamentals of Spark with Python (using PySpark), code examples

Iceberg is a table format for large, slow-moving tabular data

DataFusion has now been donated to the Apache Arrow project

Study guides for MIT's 15.003 Data Science Tools

A collection of Windows, Linux and MySQL privilege escalation scripts and exploits.

Dump the contents of a database

CTR prediction model based on spark(LR, GBDT, DNN)

SQL for Humans™

A whitespace formatter for different query languages

hadoop各组件使用，持续更新

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

Aura.Sql module for Ray.Di

Database management for VSCode

A PHP SQL query builder using PDO

REST API boilerplate using NodeJS and KOA2, typescript. Logging and JWT as middlewares. TypeORM with class-validator, SQL CRUD. Docker included. Swagger docs, actions CI and valuable README

Entity Framework Core provider for PostgreSQL

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Code-Audit-Challenges

A golang expression evaluator & Library to build SQL query engine based functionality.

Expressive types for Spark.

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Use SQL to query Elasticsearch

Universal database layer for the client, server & mobile devices. It's like Lego for databases.

The most popular open-source eCommerce shopping cart solution based on ASP.NET Core

A connector for Spark that allows reading and writing to/from Redis cluster

Modin: Speed up your Pandas workflows by changing a single line of code

Scalable genomic data analysis.

Sparkling Water provides H2O functionality inside Spark cluster

SQL import of USDA nutrient database

TypeORM module for Nest framework (node.js) 🍇

R interface for Apache Spark

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

BaikalDB, A Distributed HTAP Database.

SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics

Leantime is a lean project management system for innovators. Designed to help you manage your projects from ideation to delivery.

PHP class to make interacting with a database ridiculusly easy

Colorizing text editor for ImGui

TiDB is an open source distributed HTAP database compatible with the MySQL protocol

An easy-to-use and promise-based multi SQL dialects ORM tool for Node.js

Entity Relation Diagrams generation tool