sql-to-redis🔄 Simple tool for ETL. From SQL to Redis.
Stars: ✭ 18 (-95.1%)
Ethereum EtlPython scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Stars: ✭ 956 (+160.49%)
MuxieMuxie is a modern, fast and light HTTP multiplexer for Go. Fully compatible with the http.Handler interface. Written for everyone.
Stars: ✭ 257 (-29.97%)
Aws Auto Terminate Idle EmrAWS Auto Terminate Idle AWS EMR Clusters Framework is an AWS based solution using AWS CloudWatch and AWS Lambda using a Python script that is using Boto3 to terminate AWS EMR clusters that have been idle for a specified period of time.
Stars: ✭ 21 (-94.28%)
hamiltonA scalable general purpose micro-framework for defining dataflows. You can use it to create dataframes, numpy matrices, python objects, ML models, etc.
Stars: ✭ 612 (+66.76%)
Dswarm Backoffice WebThe backoffice web application of d:swarm (https://github.com/dswarm/dswarm-documentation/wiki)
Stars: ✭ 11 (-97%)
CoriumCorium is a modern scripting language which combines simple, safe and efficient programming.
Stars: ✭ 18 (-95.1%)
Bandar LogMonitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.
Stars: ✭ 19 (-94.82%)
coreEnterprise Grade #NodeJS Platform implementing Industry Standards & Patterns in order to provide Connectivity, Stability, High-Availability and High-Performance
Stars: ✭ 54 (-85.29%)
Getting StartedThis repository is a getting started guide to Singer.
Stars: ✭ 734 (+100%)
PgagroalHigh-performance connection pool for PostgreSQL
Stars: ✭ 362 (-1.36%)
React CsvReact components to build CSV files on the fly basing on Array/literal object of data
Stars: ✭ 732 (+99.46%)
fastverseAn Extensible Suite of High-Performance and Low-Dependency Packages for Statistical Computing and Data Manipulation in R
Stars: ✭ 123 (-66.49%)
Go StreamsA lightweight stream processing library for Go
Stars: ✭ 615 (+67.57%)
AddaxAddax is an open source universal ETL tool that supports most of those RDBMS and NoSQLs on the planet, helping you transfer data from any one place to another.
Stars: ✭ 615 (+67.57%)
Ananas DesktopA hackable data integration & analysis tool to enable non technical users to edit data processing jobs and visualise data on demand.
Stars: ✭ 551 (+50.14%)
OpenKettleWebUI一款基于kettle的数据处理web调度控制平台,支持文档资源库和数据库资源库,通过web平台控制kettle数据转换,可作为中间件集成到现有系统中
Stars: ✭ 138 (-62.4%)
BigsliceA serverless cluster computing system for the Go programming language
Stars: ✭ 469 (+27.79%)
TarsgoTarsgo is high performance RPC framework in Golang programing language using the tars protocol.
Go has become popular for programming with the rise of containerization technology such as docker, k8s, and etcd.
Go's goroutine concurrency mechanism means Go is very suitable for large-scale high-concurrency back-end server program development. The Go language has nearly C/C++ performance and near Python productivity.
In Tencent, part of the existing C++ development team has gradually turned into Go developers. Tars, a widely used RPC framework, supports C++, Java, NodeJS, and PHP, and now Go. The combination with Go language has become a general trend. Therefore, in the voice of users, we launched Tarsgo, and we have applied to Tencent map application, YingYongbao application, Internet plus and other projects.
Learn more about the whole Tars architecture and design at Introduction.
Stars: ✭ 2,931 (+698.64%)
EtlalchemyExtract, Transform, Load: Any SQL Database in 4 lines of Code.
Stars: ✭ 460 (+25.34%)
exposedHigh performance RPC framework
Stars: ✭ 28 (-92.37%)
DatacleanerThe premier open source Data Quality solution
Stars: ✭ 391 (+6.54%)
bitECSFunctional, minimal, data-oriented, ultra-high performance ECS library written in JavaScript
Stars: ✭ 372 (+1.36%)
ChoetlETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
Stars: ✭ 372 (+1.36%)
csvpluscsvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.
Stars: ✭ 67 (-81.74%)
SeaweedfsSeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Stars: ✭ 13,380 (+3545.78%)
ExprtkC++ Mathematical Expression Parsing And Evaluation Library
Stars: ✭ 301 (-17.98%)
AkubraSimple solution to keep a independent S3 storages in sync
Stars: ✭ 79 (-78.47%)
0chain0Chain is a decentralized blockchain-based storage platform with built-in privacy and security compliance. It provides high performance, enforceable SLAs, choice of providers for all enterprise grade applications.
Stars: ✭ 79 (-78.47%)
LetoA key value storage example powered by hashicorp raft and BadgerDB
Stars: ✭ 73 (-80.11%)
cardano-pyPython3 lib and cli for operating a Cardano Passive Node and using the API's. (PRE-ALPHA)
Stars: ✭ 17 (-95.37%)
Gluster SwiftObject interface to GlusterFS (this is only a public mirror)
Stars: ✭ 43 (-88.28%)
minio-dartUnofficial MinIO Dart Client SDK that provides simple APIs to access any Amazon S3 compatible object storage server.
Stars: ✭ 42 (-88.56%)
LakefsGit-like capabilities for your object storage
Stars: ✭ 847 (+130.79%)
etl managerA python package to create a database on the platform using our moj data warehousing framework
Stars: ✭ 14 (-96.19%)
Oio SdsHigh Performance Software-Defined Object Storage for Big Data and AI, that supports Amazon S3 and Openstack Swift
Stars: ✭ 465 (+26.7%)
CVparserCVparser is software for parsing or extracting data out of CV/resumes.
Stars: ✭ 28 (-92.37%)
Parse ServerAPI server module for Node/Express
Stars: ✭ 19,165 (+5122.07%)
mlbgamedayMulti-core processing of 'Gameday' data from Major League Baseball Advanced Media. Additional tools to parallelize large data sets and write them to a database.
Stars: ✭ 37 (-89.92%)
Hikaricp光 HikariCP・A solid, high-performance, JDBC connection pool at last.
Stars: ✭ 16,146 (+4299.46%)
django-calaccess-raw-dataA Django app to download, extract and load campaign finance and lobbying activity data from the California Secretary of State's CAL-ACCESS database
Stars: ✭ 61 (-83.38%)
Clevergo👅 CleverGo is a lightweight, feature rich and high performance HTTP router for Go.
Stars: ✭ 246 (-32.97%)
DataformDataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift
Stars: ✭ 342 (-6.81%)
geofeatures2A lightweight, high performance geometry library in Swift.
Stars: ✭ 18 (-95.1%)
LibheatmapHigh performance C heatmap generation library. Supposed to be wrapped by higher-level languages.
Stars: ✭ 241 (-34.33%)
spaceA SCI-FI community game server simulating space(ships). Built from the ground up to support moddable online action multiplayer and roleplay!
Stars: ✭ 25 (-93.19%)
NonblockingImplementation of a lock-free dictionary on .Net.
Stars: ✭ 237 (-35.42%)
PadeOpsA DNS and LES box code
Stars: ✭ 21 (-94.28%)
GologA high-performant Logging Foundation for Go Applications. X3 faster than the rest leveled loggers.
Stars: ✭ 208 (-43.32%)
gumbleCollection of high-performance, thread-safe, lock-free data structures for go
Stars: ✭ 12 (-96.73%)
sync-engine-exampleSynchronization Algorithm Exploration: Techniques to synchronize a SQL database with external destinations.
Stars: ✭ 17 (-95.37%)
WedatasphereWeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!
Stars: ✭ 372 (+1.36%)
MetorikkuA simplified, lightweight ETL Framework based on Apache Spark
Stars: ✭ 361 (-1.63%)
Aero🚄 High-performance web server for Go.
Stars: ✭ 354 (-3.54%)
MikadoMikado is the webs fastest template library for building user interfaces.
Stars: ✭ 323 (-11.99%)
DatavecETL Library for Machine Learning - data pipelines, data munging and wrangling
Stars: ✭ 272 (-25.89%)
dbddbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.
Stars: ✭ 30 (-91.83%)
ExtractA cross-platform command line tool for parallelised content extraction and analysis.
Stars: ✭ 188 (-48.77%)