942 Open source projects that are alternatives of or similar to openverse-catalog

The Openverse API allows programmatic access to search for CC-licensed and public domain digital media.

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Apache Airflow - OpenApi Client for Python

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

A plugin for Apache Airflow that allows you to manage the users that can login

A Data Engineering & Machine Learning Knowledge Hub

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

A plugin for Apache Airflow that allows you to edit DAGs in browser

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Curated list of resources about Apache Airflow

Functional Airflow DAG definitions.

Minikube for big data with Scala and Spark

Online search advertisement platform & Realtime Campaign Monitoring [Maybe Deprecated]

Export Airflow metrics (from mysql) in prometheus format

Udacity Data Engineering Nano Degree (DEND)

A complete development environment setup for working with Airflow

Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.

Toolbox to open & search URLs from vim

A Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.

A pytest plugin for regression testing and regenerating Jupyter Notebooks

A book written for new Lazarus users, named "Beginners’ Guide to Lazarus IDE". Moved to: https://gitlab.com/adnan360/lazarus-beginners-guide

An extensive non-reactive Typescript framework that eases the development experience in Spark AR

py.test plugin that activates the fault handler module during testing

Evildork targeting your fiancee👁️

Pytest plugin for local AWS integration tests

Spark functions to run popular phonetic and string matching algorithms

Asp.Net Core + ElasticSearch

Open-source distribute workflow schedule tools, also support streaming task.

pytest plugin for a better developer experience when working with the PyTorch test suite

IResearch is a cross-platform, high-performance document oriented search engine library written entirely in C++ with the focus on a pluggability of different ranking/similarity models

The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

Norconex Filesystem Collector is a flexible crawler for collecting, parsing, and manipulating data ranging from local hard drives to network locations into various data repositories such as search engines.

An advanced command-line search engine for Exploit-DB

📔 Page object design pattern implementation (python, pom, selenium, pytest, travisCI)

Simple full text indexing and searching library for Java

Resources for Spark AR

Apache Airflow integration for dbt

Create vertical search web application in minutes with generator (based on ItemsAPI)

Flow-Indexer indexes flows found in chunked log files from bro,nfdump,syslog, or pcap files

Use Airflow to move data from multiple MySQL databases to BigQuery

PyTest plugin for testing smart contracts for Ethereum blockchain.

No description or website provided.

Some class materials for a data processing course using PySpark

Decorate your pytest suite with RSpec-style pytest markers, then run `pytest --it` to see a plaintext spec of the test structure.

Code examples for my blog posts

A plugin for snapshot testing with pytest.

Pythonic search engine based on PyLucene.

Personal Data Engineering Projects

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Rerun pytest when your code changes

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

continuous integration rep

A free Internet is a better Internet. This Chrome browser plugin removes paywalled content from Google search results.

Mock server plugin for pytest

A ZeroNet search engine

Air Data Computer

a contextual search engine for software packages built on import2vec embeddings (https://www.code-compass.com)