559 Open source projects that are alternatives of or similar to uptasticsearch

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

@azure/cosmos has moved to a new repo https://github.com/Azure/azure-sdk-for-js

Lightweight iBoxDB Full Text Search Server for C#

Skytable is an extremely fast, secure and reliable real-time NoSQL database with automated snapshots and TLS

Example project implementing best practices for PySpark ETL jobs and applications.

Python library for building Pangeo Forge recipes.

A simple Spark-powered ETL framework that just works 🍺

Key-Value/Document store database library with btree and ARTree indexing methods, SSN-MVCC concurrency

ELT Code for your Data Warehouse

Fancy stream processing made operationally mundane

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

Blog post on ETL pipelines with Airflow

Example of an ETL Pipeline using Airflow

ACID Document Database

A rudimentary implementation of a basic document (NoSQL) database in Go

A tool for building feature stores.

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

OrientDB is the most versatile DBMS supporting Graph, Document, Reactive, Full-Text and Geospatial models in one Multi-Model product. OrientDB can run distributed (Multi-Master), supports SQL, ACID Transactions, Full-Text indexing and Reactive Queries. OrientDB Community Edition is Open Source using a liberal Apache 2 license.

🥑 ArangoDB is a native multi-model database with flexible data models for documents, graphs, and key-values. Build high performance applications using a convenient SQL-like query language or JavaScript extensions.

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

A schema-aware Scala library for data transformation

Powerful RDF Knowledge Graph Generation with [R2]RML Mappings

Beneath is a serverless real-time data platform ⚡️

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

Enterprise-grade, production-hardened, serverless data lake on AWS

NoSQL Data Engineering

[READ-ONLY] PHP - ETL (Extract Transform Load) data processing library

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

🎧 A NoSQL C#/.NET RethinkDB database driver with 100% ReQL API coverage.

Course demos and handout material for Talk Python's MongoDB Quickstart course

A scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.

A python package to create a database on the platform using our moj data warehousing framework

Lightweight Embeddable iBoxDB Full Text Search Server for Java

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

A client for connecting and running DDLs on hive metastore.

Source code of the ArangoDB online documentation

Useful SQL queries for Blockchain ETL datasets in BigQuery.

⚙️ Schedule notebooks, run them like APIs, expose securely your assets: Jupyter as a viable ⚡️ Production environment

DE or DIE meetup made by data engineers for data engineers. Currently in Russian only.

Unofficial Cordova plugin for Realm Mobile Database.

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Live import all your Google Sheets to your data warehouse

Metropolitan Transport Network from São Paulo mapped in a NoSQL graph database.

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.

The command-line tool for NeDB

Wiki system in PHP+NoDB in just one file. 10s setup + auto-installed. Full Markdown support. Super fast and lightweight (-0.01MB gzip). Multi-User support. Minimal and beautiful.

Yet Another ETL in PHP

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

Dummy variable generation with fit/transform capabilities

BETL. Meta data driven ETL generation using T-SQL

Free, Open source, Fast, Headless, Multi-tenant eCommerce platform built with .NET Core, MongoDB, AWS DocumentDB, Azure CosmosDB, LiteDB, Vue.js.

Easy way to define, execute and store quality rules for your data.

A fast, low memory, transactional, index & query enabled NoSQL database engine and server for node.js and browser with realtime data change notifications

Starlake is a Spark Based On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

Datart is a next generation Data Visualization Open Platform

PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2

A collection of online resources to help you on your Tech journey.

Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

DEPRECATED: Stream data processing micro-framework

数据采集平台zdh,etl 处理服务