1500 Open source projects that are alternatives of or similar to Great_expectations

Create HTML profiling reports from pandas DataFrame objects

Visualize and compare datasets, target values and associations, with one line of code.

Librería para la evaluación de calidad de datos, e interacción con el portal de datos.gov.co

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

A library for managing, validating, summarizing, and visualizing data.

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

A day to day plan for this challenge. Covers both theoritical and practical aspects

data⎰describe: Pythonic EDA Accelerator for Data Science

PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more

Complete-Life-Cycle-of-a-Data-Science-Project

DataPrep — The easiest way to prepare data in Python

A simple Spark-powered ETL framework that just works 🍺

R package for exploratory data analysis

📊 📋 Dashboards using YAML or JSON files

Accelerate data science

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Lightweight, Python library for fast and reproducible experimentation 🔬

A tool for building feature stores.

Automate Data Exploration and Treatment

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

A Clojure dataframe library that runs on Spark

📝 A compilation of everything that I learn; Computer Science, Software Development, Engineering, Math, and Coding in General. Read the rendered results here ->

Metric collection, data testing and monitoring for SQL accessible data

The Accelerator is a tool for fast and reproducible processing of large amounts of data.

An automatic ML model optimization tool.

LAMA - automatic model creation framework

A package to easily open an instance of a Google spreadsheet and interact with worksheets through Pandas DataFrames.

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

A Julia package for piping a value through a series of transformation expressions using a more convenient syntax than Julia's native piping functionality.

Apache Superset is a Data Visualization and Data Exploration Platform

Open solution to the TGS Salt Identification Challenge

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

Easy way to define, execute and store quality rules for your data.

Data transformations for the ML era

Open solution to the Toxic Comment Classification Challenge

Deploy machine learning projects developed in Python, to Kubernetes. Accelerated MLOps 🚀

A Python framework for creating reproducible, maintainable and modular data science code.

A collection of scripts written to complete DQLab Data Analyst Career Track 📊

Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟

Engine for ML/Data tracking, visualization, dashboards, and model UI for Polyaxon.

A package that makes it trivial to create and evaluate machine learning pipeline architectures.

A declarative KubeFlow Management Tool

skimpy is a light weight tool that provides summary statistics about variables in data frames within the console.

Data analysis and visualization with PyData ecosystem: Pandas, Matplotlib Numpy, and Seaborn

A Toolkit for Interactive Statistical Data Visualization

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.

Deployment template for a continuous training pipeline.

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

Monitor the stability of a Pandas or Spark dataframe ⚙︎

Beneath is a serverless real-time data platform ⚡️

A Python framework for creating reproducible, maintainable and modular data science code.

Machine Learning Platform for Kubernetes (MLOps tools for experimentation and automation)

OlliePy is a python package which can help data scientists in exploring their data and evaluating and analysing their machine learning experiments by utilising the power and structure of modern web applications. The data scientist only needs to provide the data and any required information and OlliePy will generate the rest.

Dataset format for AI. Build, manage, & visualize datasets for deep learning. Stream data real-time to PyTorch/TensorFlow & version-control it. https://activeloop.ai

A list of software and papers related to automatic and fast Exploratory Data Analysis

Open solution to the Mapping Challenge 🌎

There are plenty of courses and tutorials that can help you learn machine learning from scratch but here in GitHub, I want to solve some Kaggle competitions as a comprehensive workflow with python packages. After reading, you can use this workflow to solve other real problems and use it as a template.

An R-focused pipeline toolkit for reproducibility and high-performance computing

A convention over configuration workflow orchestrator. Develop locally (Jupyter or your favorite editor), deploy to Airflow or Kubernetes.