744 Open source projects that are alternatives of or similar to sparklanes

Example of an ETL Pipeline using Airflow

A hands-on DevOps course covering the culture, methods and repeated practices of modern software development involving Packer, Vagrant, VirtualBox, Ansible, Kubernetes, K3s, MetalLB, Traefik, Docker-Compose, Docker, Taiga, GitLab, Drone CI, SonarQube, Selenium, InSpec, Alpine 3.10, Ubuntu-bionic, CentOS 7...

C++ implementation of CAN ISO 15765-2 also known as CAN ISO transport protocol. CPP CAN isotp.

Data pipelining service

ELT Code for your Data Warehouse

☔️ => ⛅️ => ☀️

Virtual Machine for Desktop Search with Open Semantic Search

code, labs and lectures for the course

GAMECHANGER aspires to be the Department’s trusted solution for evidence-based, data-driven decision-making across the universe of DoD requirements

zUMIs: A fast and flexible pipeline to process RNA sequencing data with UMIs

Python3 lib and cli for operating a Cardano Passive Node and using the API's. (PRE-ALPHA)

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

ETL for the SPDR ETF holdings XLS documents

pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.

The Taxonomy for ETL Automation Metadata (TEAM) is a metadata management tool for data warehouse automation. It is part of the ecosystem for data warehouse automation, alongside the Virtual Data Warehouse pattern manager and the generic schema for Data Warehouse Automation.

An Apache Pulsar client written in Elixir

Data transformation framework for LinkML data models

A repository for setting up a RNAseq workflow

Enterprise Grade Single-Step Streaming Data Infrastructure Setup. (Under Development)

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

为DataX(https://github.com/alibaba/DataX) 提供远程多语言调用（ThriftServer，HttpServer） 分布式运行（DataX on YARN） 功能

Open Source Pipeline for Maya, Houdini, 3ds Max and Nuke .

A pipelined implementation of the MIPS processor featuring hazard detection as well as forwarding

Apache Spark (PySpark) Practice on Real Data

A list of resources and tutorials for those doing programming in Unity.

Isolation Forest on Spark

Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

云研发，是一种生于云上的闭环 + 代码化的软件开发方式。它可以让业务人员、开发人员、运营人员等在同一个云端共同协作、透明化地完成整个软件的生命周期（需求、设计、编码、构建、部署、运营），而非相互隔离，又或者是借助于多个软件才能完成工作。

Generic but comprehensive pipeline for prokaryotic genome annotation and interrogation with interactive reports and shiny app.

Process Common Crawl data with Python and Spark

Kubernetes operator to manage installation, updation and uninstallation of tektoncd projects (pipeline, …)

BERT, AWS RDS, AWS Forecast, EMR Spark Cluster, Hive, Serverless, Google Assistant + Raspberry Pi, Infrared, Google Cloud Platform Natural Language, Anomaly detection, Tensorflow, Mathematics

Exome/Capture/RNASeq Pipeline Implementation using snakemake

🐍 Quick reference guide to common patterns & functions in PySpark.

spacy-wordnet creates annotations that easily allow the use of wordnet and wordnet domains by using the nltk wordnet interface

Apache (Py)Spark type annotations (stub files).

Content builder library for MonoGame.

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Elastic Crontab System 简单易用的分布式定时任务管理系统

[NOT MAINTAINED] Predicting Bit coin price using Time series analysis and sentiment analysis of tweets on bitcoin

A pixel classification based multiplexed image segmentation pipeline

Word2Vec models with Twitter data using Spark. Blog:

Open solution to the Toxic Comment Classification Challenge

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

MTBseq is an automated pipeline for mapping, variant calling and detection of resistance mediating and phylogenetic variants from illumina whole genome sequence data of Mycobacterium tuberculosis complex isolates.

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Forecast stock prices using machine learning approach. A time series analysis. Employ the Use of Predictive Modeling in Machine Learning to Forecast Stock Return. Approach Used by Hedge Funds to Select Tradeable Stocks

Old specification for Hack pipes in JavaScript. Please go to the new specification.

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

Multi-sample somatic variant caller

Simple and flexible ML workflow engine

Cloud ready pure-python streaming data pipeline library

FreeCAD - flamingo workbench

A Kafka Connect source connector that generates data for tests

Rivery CLI

🦾 Main repository for the Mech programming language. Start here!

网站点击流离线日志分析

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

R package: Misc. Functions for Processing and Sample Selection of Spectroscopic Data