465 Open source projects that are alternatives of or similar to datajob

🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript

Saisoku is a Python module that helps you build complex pipelines of batch file/directory transfer/sync jobs.

Get notified for Instances mistakenly left running across all AWS regions for specific AWS Account

This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.

基于bert4keras的GLUE基准代码

An end-to-end machine learning and data mining framework on Hadoop

A hands-on DevOps course covering the culture, methods and repeated practices of modern software development involving Packer, Vagrant, VirtualBox, Ansible, Kubernetes, K3s, MetalLB, Traefik, Docker-Compose, Docker, Taiga, GitLab, Drone CI, SonarQube, Selenium, InSpec, Alpine 3.10, Ubuntu-bionic, CentOS 7...

zUMIs: A fast and flexible pipeline to process RNA sequencing data with UMIs

Tools for constructing simple make-like pipelines in R.

AWS CDK construct for AWS Chalice

A repository for setting up a RNAseq workflow

Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.

Short course on the targets R package

LAMA - automatic model creation framework

Track translations and automate workflow.

☔️ => ⛅️ => ☀️

High performance transport protocol for distributed applications.

pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.

Deployment template for a continuous training pipeline.

MorphL Community Edition uses big data and machine learning to predict user behaviors in digital products and services with the end goal of increasing KPIs (click-through rates, conversion rates, etc.) through personalization

Open Source Pipeline for Maya, Houdini, 3ds Max and Nuke .

A list of resources and tutorials for those doing programming in Unity.

云研发，是一种生于云上的闭环 + 代码化的软件开发方式。它可以让业务人员、开发人员、运营人员等在同一个云端共同协作、透明化地完成整个软件的生命周期（需求、设计、编码、构建、部署、运营），而非相互隔离，又或者是借助于多个软件才能完成工作。

Functional Pipeline in Go

An optimized docker image includes Android, Kotlin, Flutter sdk.

Kubernetes operator to manage installation, updation and uninstallation of tektoncd projects (pipeline, …)

🐟 High Performance Computing over Kubernetes - Core Repo 🎣

spacy-wordnet creates annotations that easily allow the use of wordnet and wordnet domains by using the nltk wordnet interface

FlowCraft: a component-based pipeline composer for omics analysis using Nextflow. 🐳📦

UNDER DEVELOPMENT--- Analysis of long non-coding RNAs from RNA-seq datasets

Identify hardcoded secrets and dangerous behaviours

A Clojure machine learning library

Jenkins实践文档 最新站点地址: http://www.idevops.site

Maya > Arnold > Nuke pipeline

A Drone plugin for caching current workspace files between builds to reduce your build times

🤖🎩assume-role-arn allows you to easily assume an AWS IAM role in your CI/CD pipelines, without worrying about external dependencies.

Jenkins pipeline steps which provides SSH facilities such as command execution or file transfer for continuous delivery.

Managed Machine Learning Systems and Internet of Things Live Lesson

Old archived draft proposal for smart pipelines. Go to the new Hack-pipes proposal at js-choi/proposal-hack-pipes.

The magic message bus

Function Composition for OpenFaaS

Generalised and highly customisable, hybrid-parallelism, database based, deep learning framework.

VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.

This repo is no longer updated. Please see https://github.com/Autodesk/maya-usd

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

A comprehensive tool for processing, analyzing and visulizing single cell chromatin accessibility sequencing data

A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.

Cycle-accurate pre-silicon simulator of RISC-V and MIPS CPUs

The safe post-production pipeline - https://getavalon.github.io/2.0

Blog post on ETL pipelines with Airflow

Learn how to build a CI/CD pipeline for SAM-based applications

A CLI for interacting with Tekton!

🏭 PDF text extraction pipeline: self-hosted, local-first, Docker-based

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

A package that makes it trivial to create and evaluate machine learning pipeline architectures.

Elastic Crontab System 简单易用的分布式定时任务管理系统

Fluid dynamics component of Chemical Engineering Design Library (ChEDL)

🔬 BEDOPS: high-performance genomic feature operations

Projects developed by Domino's R&D team

Build HTTP API Based Services using Amazon API Gateway, AWS PrivateLink, AWS Fargate and AWS CDK