This curated list contains 890 awesome open-source projects with a total of 3.2M stars grouped into 33 categories. All projects are ranked by a project-quality score, which is calculated based on various metrics automatically collected from GitHub and different package managers. If you like to add or update projects, feel free to open an issue, submit a pull request, or directly edit the projects.yaml. Contributions are very welcome!
Contents
- Machine Learning Frameworks 55 projects
- Data Visualization 50 projects
- Text Data & NLP 90 projects
- Image Data 56 projects
- Graph Data 32 projects
- Audio Data 27 projects
- Geospatial Data 21 projects
- Financial Data 23 projects
- Time Series Data 23 projects
- Medical Data 19 projects
- Tabular Data 3 projects
- Optical Character Recognition 11 projects
- Data Containers & Structures 29 projects
- Data Loading & Extraction 1 projects
- Web Scraping & Crawling 1 projects
- Data Pipelines & Streaming 42 projects
- Distributed Machine Learning 29 projects
- Hyperparameter Optimization & AutoML 47 projects
- Reinforcement Learning 21 projects
- Recommender Systems 15 projects
- Privacy Machine Learning 6 projects
- Workflow & Experiment Tracking 36 projects
- Model Serialization & Deployment 14 projects
- Model Interpretability 50 projects
- Vector Similarity Search (ANN) 12 projects
- Probabilistics & Statistics 23 projects
- Adversarial Robustness 9 projects
- GPU Utilities 18 projects
- Tensorflow Utilities 15 projects
- Sklearn Utilities 17 projects
- Pytorch Utilities 31 projects
- Database Clients 1 projects
- Others 57 projects
Explanation
🥇 🥈 🥉 Combined project-quality score⭐️ Star count from GitHub🐣 New project (less than 6 months old)💤 Inactive project (6 months no activity)💀 Dead project (12 months no activity)📈 📉 Project is trending up or down➕ Project was recently added❗️ Warning (e.g. missing/risky license)👨💻 Contributors count from GitHub🔀 Fork count from GitHub📋 Issue count from GitHub⏱️ Last update timestamp on package manager📥 Download count from package manager📦 Number of dependent projects- Tensorflow related project
- Sklearn related project
- PyTorch related project
- MxNet related project
- Apache Spark related project
- Jupyter related project
- PaddlePaddle related project
- Pandas related project
Machine Learning Frameworks
General-purpose machine learning and deep learning frameworks.
XGBoost (🥇 38 · ⭐ 22K) - Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or.. Apache-2
Tensorflow (🥇 37 · ⭐ 160K) - An Open Source Machine Learning Framework for Everyone. Apache-2
-
GitHub (
👨💻 880 ·🔀 86K):git clone https://github.com/tensorflow/tensorflow
-
PyPi (
📥 7.2M / month ·📦 23K ·⏱️ 04.11.2021):pip install tensorflow
-
Conda (
📥 2.9M ·⏱️ 08.12.2021):conda install -c conda-forge tensorflow
-
Docker Hub (
📥 62M ·⭐ 2K ·⏱️ 09.12.2021):docker pull tensorflow/tensorflow
scikit-learn (🥇 37 · ⭐ 48K) - scikit-learn: machine learning in Python. BSD-3
LightGBM (🥇 36 · ⭐ 13K) - A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT,.. MIT
pytorch-lightning (🥈 35 · ⭐ 17K) - The lightweight PyTorch wrapper for high-performance.. Apache-2
Theano (🥈 35 · ⭐ 9.5K) - Theano was a Python library that allows you to define, optimize, and.. BSD-3
StatsModels (🥈 33 · ⭐ 6.9K) - Statsmodels: statistical modeling and econometrics in Python. BSD-3
Thinc (🥈 33 · ⭐ 2.4K) - A refreshing functional take on deep learning, compatible with your favorite.. MIT
PaddlePaddle (🥈 31 · ⭐ 17K) - PArallel Distributed Deep LEarning: Machine Learning.. Apache-2
Catboost (🥈 31 · ⭐ 6.3K) - A fast, scalable, high performance Gradient Boosting on Decision.. Apache-2
Jina (🥈 29 · ⭐ 12K) - Cloud-native neural search framework for kind of data. Apache-2
-
GitHub (
👨💻 130 ·🔀 1.7K ·📦 180 ·📋 1.2K - 5% open ·⏱️ 09.12.2021):git clone https://github.com/jina-ai/jina
-
PyPi (
📥 7.3K / month ·⏱️ 09.12.2021):pip install jina
-
Docker Hub (
📥 990K ·⭐ 6 ·⏱️ 09.12.2021):docker pull jinaai/jina
Vowpal Wabbit (🥈 29 · ⭐ 7.8K) - Vowpal Wabbit is a machine learning system which pushes the.. BSD-3
tensorpack (🥈 29 · ⭐ 6.1K) - A Neural Net Training Interface on TensorFlow, with focus.. Apache-2
einops (🥈 29 · ⭐ 4K) - Deep learning operations reinvented (for pytorch, tensorflow, jax and others). MIT
Turi Create (🥉 26 · ⭐ 11K) - Turi Create simplifies the development of custom machine learning.. BSD-3
Neural Network Libraries (🥉 25 · ⭐ 2.5K) - Neural Network Libraries. Apache-2
tensorflow-upstream (🥉 24 · ⭐ 570) - TensorFlow ROCm port. Apache-2
SHOGUN (🥉 22 · ⭐ 2.9K · 💤 ) - Unified and efficient Machine Learning. BSD-3
-
GitHub (
👨💻 250 ·🔀 1K ·📋 1.5K - 28% open ·⏱️ 08.12.2020):git clone https://github.com/shogun-toolbox/shogun
-
Conda (
📥 110K ·⏱️ 25.06.2018):conda install -c conda-forge shogun
-
Docker Hub (
📥 1.5K ·⭐ 1 ·⏱️ 31.01.2019):docker pull shogun/shogun
Neural Tangents (🥉 21 · ⭐ 1.6K) - Fast and Easy Infinite Neural Networks in Python. Apache-2
mace (🥉 20 · ⭐ 4.5K) - MACE is a deep learning inference framework optimized for mobile.. Apache-2
-
GitHub (
👨💻 63 ·🔀 770 ·📥 1.4K ·📋 650 - 6% open ·⏱️ 06.12.2021):git clone https://github.com/XiaoMi/mace
Haiku (🥉 20 · ⭐ 1.5K) - JAX-based neural network library. Apache-2
-
GitHub (
👨💻 53 ·🔀 120 ·📦 260 ·📋 130 - 26% open ·⏱️ 02.12.2021):git clone https://github.com/deepmind/dm-haiku
ThunderSVM (🥉 19 · ⭐ 1.4K · 💤 ) - ThunderSVM: A Fast SVM Library on GPUs and CPUs. Apache-2
Torchbearer (🥉 19 · ⭐ 610 · 💤 ) - torchbearer: A model fitting library for PyTorch. MIT
ThunderGBM (🥉 16 · ⭐ 620 · 💤 ) - ThunderGBM: Fast GBDTs and Random Forests on GPUs. Apache-2
NeoML (🥉 15 · ⭐ 660) - Machine learning framework for both deep learning and traditional.. Apache-2
-
GitHub (
👨💻 25 ·🔀 97 ·📋 50 - 56% open ·⏱️ 09.12.2021):git clone https://github.com/neoml-lib/neoml
Show 12 hidden projects...
- dlib (
🥈 33 ·⭐ 11K) - A toolkit for making real world machine learning and data analysis..❗️BSL-1.0
- TFlearn (
🥉 28 ·⭐ 9.6K ·💀 ) - Deep learning library featuring a higher-level API for TensorFlow.MIT
- CNTK (
🥉 25 ·⭐ 17K ·💀 ) - Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit.MIT
- NuPIC (
🥉 24 ·⭐ 6.3K ·💀 ) - Numenta Platform for Intelligent Computing is an implementation..❗️AGPL-3.0
- Lasagne (
🥉 24 ·⭐ 3.8K ·💀 ) - Lightweight library to build and train neural networks in Theano.MIT
- xLearn (
🥉 24 ·⭐ 3K ·💀 ) - High performance, easy-to-use, and scalable machine learning (ML)..Apache-2
- NeuPy (
🥉 22 ·⭐ 700 ·💀 ) - NeuPy is a Tensorflow based python library for prototyping and building..MIT
- MindsDB (
🥉 20 ·⭐ 4.2K) - Predictive AI layer for existing databases.❗️GPL-3.0
- neon (
🥉 19 ·⭐ 3.9K ·💀 ) - Intel Nervana reference deep learning framework committed to best..Apache-2
- chefboost (
🥉 19 ·⭐ 290) - A Lightweight Decision Tree Framework supporting regular algorithms:..MIT
- elegy (
🥉 18 ·⭐ 300) - A High Level API for Deep Learning in JAX.MIT
jax
- StarSpace (
🥉 13 ·⭐ 3.7K ·💀 ) - Learning embeddings for classification, retrieval and ranking.MIT
Data Visualization
General-purpose and task-specific data visualization libraries.
Matplotlib (🥇 37 · ⭐ 15K) - matplotlib: plotting with Python. Python-2.0
Plotly (🥇 36 · ⭐ 11K) - The interactive graphing library for Python (includes Plotly Express). MIT
-
GitHub (
👨💻 190 ·🔀 2K ·📦 5 ·📋 2.2K - 46% open ·⏱️ 04.12.2021):git clone https://github.com/plotly/plotly.py
-
PyPi (
📥 4.7M / month ·📦 5K ·⏱️ 15.11.2021):pip install plotly
-
Conda (
📥 2.1M ·⏱️ 15.11.2021):conda install -c conda-forge plotly
-
NPM (
📥 57K / month ·📦 4 ·⏱️ 12.01.2021):npm install plotlywidget
pandas-profiling (🥇 33 · ⭐ 8.3K) - Create HTML profiling reports from pandas DataFrame.. MIT
HoloViews (🥈 29 · ⭐ 2.1K) - With Holoviews, your data visualizes itself. BSD-3
-
GitHub (
👨💻 120 ·🔀 330 ·📋 2.7K - 29% open ·⏱️ 08.12.2021):git clone https://github.com/holoviz/holoviews
-
PyPi (
📥 120K / month ·📦 170 ·⏱️ 17.09.2021):pip install holoviews
-
Conda (
📥 610K ·⏱️ 17.09.2021):conda install -c conda-forge holoviews
-
NPM (
📥 3.4K / month ·⏱️ 24.05.2020):npm install @pyviz/jupyterlab_pyviz
bqplot (🥈 28 · ⭐ 3.2K) - Plotting library for IPython/Jupyter notebooks. Apache-2
-
GitHub (
👨💻 55 ·🔀 440 ·📦 28 ·📋 570 - 38% open ·⏱️ 02.12.2021):git clone https://github.com/bqplot/bqplot
-
PyPi (
📥 34K / month ·📦 110 ·⏱️ 01.10.2021):pip install bqplot
-
Conda (
📥 900K ·⏱️ 01.10.2021):conda install -c conda-forge bqplot
-
NPM (
📥 24K / month ·📦 10 ·⏱️ 01.10.2021):npm install bqplot
datashader (🥈 28 · ⭐ 2.7K) - Quickly and accurately render even the largest data. BSD-3
data-validation (🥈 28 · ⭐ 590) - Library for exploring and validating machine learning.. Apache-2
Perspective (🥈 27 · ⭐ 4K) - A data visualization and analytics component, especially.. Apache-2
Facets Overview (🥉 26 · ⭐ 6.7K · 💤 ) - Visualizations for machine learning datasets. Apache-2
hvPlot (🥉 26 · ⭐ 480) - A high-level plotting API for pandas, dask, xarray, and networkx built on.. BSD-3
D-Tale (🥉 25 · ⭐ 2.8K) - Visualizer for pandas data structures. ❗️LGPL-2.1
pythreejs (🥉 25 · ⭐ 770 · 📈 ) - A Jupyter - Three.js bridge. BSD-3
-
GitHub (
👨💻 29 ·🔀 160 ·📦 19 ·📋 210 - 31% open ·⏱️ 06.12.2021):git clone https://github.com/jupyter-widgets/pythreejs
-
PyPi (
📥 21K / month ·📦 26 ·⏱️ 26.02.2021):pip install pythreejs
-
Conda (
📥 350K ·⏱️ 02.03.2021):conda install -c conda-forge pythreejs
-
NPM (
📥 6.1K / month ·📦 8 ·⏱️ 26.02.2021):npm install jupyter-threejs
Chartify (🥉 23 · ⭐ 3K · 💤 ) - Python library that makes it easy for data scientists to create.. Apache-2
HyperTools (🥉 23 · ⭐ 1.7K) - A Python toolbox for gaining geometric insights into high-dimensional.. MIT
python-ternary (🥉 23 · ⭐ 500) - Ternary plotting library for python with matplotlib. MIT
Pandas-Bokeh (🥉 22 · ⭐ 730 · 💤 ) - Bokeh Plotting Backend for Pandas and GeoPandas. MIT
AutoViz (🥉 22 · ⭐ 560) - Automatically Visualize any dataset, any size with a single line of.. Apache-2
Sweetviz (🥉 21 · ⭐ 1.8K) - Visualize and compare datasets, target values and associations, with one.. MIT
Show 10 hidden projects...
- cartopy (
🥈 28 ·⭐ 970) - Cartopy - a cartographic python library with matplotlib support.❗️LGPL-3.0
- plotnine (
🥈 27 ·⭐ 2.9K) - A grammar of graphics for Python.❗️GPL-2.0
- Multicore-TSNE (
🥉 23 ·⭐ 1.7K ·💀 ) - Parallel t-SNE implementation with Python and Torch..BSD-3
- pivottablejs (
🥉 21 ·⭐ 450 ·💀 ) - Dragndrop Pivot Tables and Charts for Jupyter/IPython..MIT
- ivis (
🥉 19 ·⭐ 250) - Dimensionality reduction in very large datasets using Siamese..Apache-2
- animatplot (
🥉 18 ·⭐ 390 ·💀 ) - A python package for animating plots build on matplotlib.MIT
- nx-altair (
🥉 17 ·⭐ 180 ·💀 ) - Draw interactive NetworkX graphs with Altair.MIT
- pdvega (
🥉 16 ·⭐ 340 ·💀 ) - Interactive plotting for Pandas using Vega-Lite.MIT
- data-describe (
🥉 15 ·⭐ 290) - datadescribe: Pythonic EDA Accelerator for Data Science.Apache-2
- nptsne (
🥉 14 ·⭐ 27 ·💤 ) - nptsne is a numpy compatible python binary package that offers a..Apache-2
Text Data & NLP
Libraries for processing, cleaning, manipulating, and analyzing text data as well as libraries for NLP tasks such as language detection, fuzzy matching, classification, seq2seq learning, conversational AI, keyword extraction, and translation.
transformers (🥇 38 · ⭐ 55K) - Transformers: State-of-the-art Machine Learning for.. Apache-2
gensim (🥇 36 · ⭐ 13K) - Topic Modelling for Humans. ❗️LGPL-2.1
nltk (🥇 35 · ⭐ 10K) - Suite of libraries and programs for symbolic and statistical natural.. Apache-2
ChatterBot (🥇 31 · ⭐ 12K) - ChatterBot is a machine learning, conversational dialog engine for.. BSD-3
flair (🥇 31 · ⭐ 11K) - A very simple framework for state-of-the-art Natural Language Processing.. MIT
sentence-transformers (🥇 30 · ⭐ 6.6K) - Multilingual Sentence & Image Embeddings with BERT. Apache-2
sentencepiece (🥇 30 · ⭐ 5.5K) - Unsupervised text tokenizer for Neural Network-based text.. Apache-2
TensorFlow Text (🥈 29 · ⭐ 850) - Making text a first-class citizen in TensorFlow. Apache-2
snowballstemmer (🥈 29 · ⭐ 530) - Snowball compiler and stemming algorithms. BSD-3
TextDistance (🥈 28 · ⭐ 2.6K) - Compute distance between sequences. 30+ algorithms, pure python.. MIT
DeepPavlov (🥈 27 · ⭐ 5.5K) - An open source library for deep learning end-to-end dialog.. Apache-2
Tokenizers (🥈 27 · ⭐ 5.1K) - Fast State-of-the-Art Tokenizers optimized for Research and.. Apache-2
spacy-transformers (🥈 26 · ⭐ 1.1K) - Use pretrained transformers like BERT, XLNet and GPT-2.. MIT
spacy
vaderSentiment (🥈 25 · ⭐ 3.3K · 💤 ) - VADER Sentiment Analysis. VADER (Valence Aware Dictionary.. MIT
haystack (🥈 25 · ⭐ 2.9K) - Haystack is an open source NLP framework that leverages Transformer.. Apache-2
neuralcoref (🥈 25 · ⭐ 2.4K) - Fast Coreference Resolution in spaCy with Neural Networks. MIT
scattertext (🥈 25 · ⭐ 1.7K) - Beautiful visualizations of how language differs among document.. Apache-2
Ciphey (🥉 24 · ⭐ 9.1K) - Automatically decrypt encryptions without knowing the key or cipher,.. MIT
-
GitHub (
👨💻 46 ·🔀 560 ·📋 280 - 18% open ·⏱️ 03.11.2021):git clone https://github.com/Ciphey/Ciphey
-
PyPi (
📥 8.9K / month ·⏱️ 06.06.2021):pip install ciphey
-
Docker Hub (
📥 14K ·⭐ 5 ·⏱️ 16.11.2021):docker pull remnux/ciphey
fastNLP (🥉 24 · ⭐ 2.4K) - fastNLP: A Modularized and Extensible NLP Framework. Currently still.. Apache-2
PyTextRank (🥉 24 · ⭐ 1.7K) - Python implementation of TextRank for phrase extraction and.. MIT
english-words (🥉 23 · ⭐ 5.8K) - A text file containing 479k English words for all your.. Unlicense
pytorch-nlp (🥉 23 · ⭐ 2K) - Basic Utilities for PyTorch Natural Language Processing (NLP). BSD-3
pySBD (🥉 22 · ⭐ 390 · 💤 ) - pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence.. MIT
DeepMatcher (🥉 21 · ⭐ 3.9K) - Python package for performing Entity and Text Matching using Deep.. BSD-3
gpt-2-simple (🥉 21 · ⭐ 2.8K) - Python package to easily retrain OpenAI's GPT-2 text-.. MIT
Texthero (🥉 21 · ⭐ 2.4K) - Text preprocessing, representation and visualization from zero to hero. MIT
SciSpacy (🥉 21 · ⭐ 1.1K) - A full spaCy pipeline and models for scientific/biomedical documents. Apache-2
YouTokenToMe (🥉 21 · ⭐ 780 · 💤 ) - Unsupervised text tokenizer focused on computational efficiency. MIT
lightseq (🥉 20 · ⭐ 1.8K) - LightSeq: A High Performance Library for Sequence Processing and.. Apache-2
DELTA (🥉 20 · ⭐ 1.5K · 💤 ) - DELTA is a deep learning based natural language and speech.. Apache-2
-
GitHub (
👨💻 41 ·🔀 290 ·📋 79 - 6% open ·⏱️ 17.12.2020):git clone https://github.com/Delta-ML/delta
-
PyPi (
📥 12 / month ·⏱️ 27.03.2020):pip install delta-nlp
-
Docker Hub (
📥 13K ·⏱️ 03.08.2021):docker pull zh794390558/delta
NLP Architect (🥉 19 · ⭐ 2.8K) - A model library for exploring state-of-the-art deep learning.. Apache-2
OpenNRE (🥉 15 · ⭐ 3.4K) - An Open-Source Package for Neural Relation Extraction (NRE). MIT
-
GitHub (
👨💻 10 ·🔀 900 ·📋 340 - 6% open ·⏱️ 06.12.2021):git clone https://github.com/thunlp/OpenNRE
BLINK (🥉 11 · ⭐ 770 · 💤 ) - Entity Linker solution. MIT
-
GitHub (
👨💻 16 ·🔀 140 ·📋 74 - 60% open ·⏱️ 02.04.2021):git clone https://github.com/facebookresearch/BLINK
Show 22 hidden projects...
- fastText (
🥇 30 ·⭐ 23K ·💀 ) - Library for fast text representation and classification.MIT
- fuzzywuzzy (
🥇 30 ·⭐ 8.6K) - Fuzzy String Matching in Python.❗️GPL-2.0
- langid (
🥈 26 ·⭐ 1.9K ·💀 ) - Stand-alone language identification system.BSD-3
- polyglot (
🥉 24 ·⭐ 1.9K ·💀 ) - Multilingual text (NLP) processing toolkit.❗️GPL-3.0
- flashtext (
🥉 23 ·⭐ 5K ·💀 ) - Extract Keywords from sentence or Replace keywords in sentences.MIT
- textgenrnn (
🥉 23 ·⭐ 4.6K ·💀 ) - Easily train your own text-generating neural network of any..MIT
- stop-words (
🥉 22 ·⭐ 130 ·💀 ) - Get list of common stop words in various languages in Python.BSD-3
- Texar (
🥉 21 ·⭐ 2.2K ·💀 ) - Toolkit for Machine Learning, Natural Language Processing, and..Apache-2
- pyfasttext (
🥉 20 ·⭐ 230 ·💀 ) - Yet another Python binding for fastText.❗️GPL-3.0
- NeuroNER (
🥉 18 ·⭐ 1.6K ·💀 ) - Named-entity recognition using neural networks. Easy-to-use and..MIT
- textpipe (
🥉 18 ·⭐ 290) - Textpipe: clean and extract metadata from text.MIT
- fastT5 (
🥉 18 ·⭐ 230) - boost inference speed of T5 models by 5x & reduce the model size by 3x.Apache-2
- skift (
🥉 18 ·⭐ 220 ·💤 ) - scikit-learn wrappers for Python fastText.MIT
- textaugment (
🥉 18 ·⭐ 190) - TextAugment: Text Augmentation Library.MIT
- nboost (
🥉 17 ·⭐ 600 ·💀 ) - NBoost is a scalable, search-api-boosting platform for deploying..Apache-2
- Headliner (
🥉 15 ·⭐ 230 ·💀 ) - Easy training and deployment of seq2seq models.MIT
- NeuralQA (
🥉 15 ·⭐ 220 ·💤 ) - NeuralQA: A Usable Library for Question Answering on Large Datasets..MIT
- TransferNLP (
🥉 14 ·⭐ 290 ·💀 ) - NLP library designed for reproducible experimentation..MIT
- ONNX-T5 (
🥉 14 ·⭐ 190 ·💤 ) - Summarization, translation, sentiment-analysis, text-generation..Apache-2
- textvec (
🥉 14 ·⭐ 180 ·💤 ) - Text vectorization tool to outperform TFIDF for classification..MIT
- numerizer (
🥉 14 ·⭐ 130 ·💤 ) - A Python module to convert natural language numerics into ints and..MIT
- spacy-dbpedia-spotlight (
🥉 11 ·⭐ 45 ·💤 ) - A spaCy wrapper for DBpedia Spotlight.MIT
spacy
Image Data
Libraries for image & video processing, manipulation, and augmentation as well as libraries for computer vision tasks such as facial recognition, object detection, and classification.
scikit-image (🥇 34 · ⭐ 4.7K) - Image processing in Python. BSD-2
torchvision (🥇 32 · ⭐ 10K) - Datasets, Transforms and Models specific to Computer Vision. BSD-3
Albumentations (🥇 32 · ⭐ 9.3K) - Fast image augmentation library and an easy-to-use wrapper.. MIT
PyTorch Image Models (🥈 30 · ⭐ 15K) - PyTorch image models, scripts, pretrained weights --.. Apache-2
-
GitHub (
👨💻 61 ·🔀 2.3K ·📥 760K ·📦 1.5K ·📋 430 - 13% open ·⏱️ 24.11.2021):git clone https://github.com/rwightman/pytorch-image-models
opencv-python (🥈 30 · ⭐ 2.4K) - Automated CI toolchain to produce precompiled opencv-python,.. MIT
Face Recognition (🥈 29 · ⭐ 42K) - The world's simplest facial recognition api for Python.. MIT
InsightFace (🥈 29 · ⭐ 11K) - State-of-the-art 2D and 3D Face Analysis Project. MIT
imageai (🥈 27 · ⭐ 6.7K · 💤 ) - A python library built to empower developers to build applications.. MIT
detectron2 (🥈 26 · ⭐ 19K) - Detectron2 is a platform for object detection, segmentation.. Apache-2
MMDetection (🥈 26 · ⭐ 18K) - OpenMMLab Detection Toolbox and Benchmark. Apache-2
-
GitHub (
👨💻 280 ·🔀 6.2K ·📦 190 ·📋 4.9K - 7% open ·⏱️ 30.11.2021):git clone https://github.com/open-mmlab/mmdetection
Face Alignment (🥉 25 · ⭐ 5.4K) - 2D and 3D Face alignment library build using pytorch. BSD-3
facenet-pytorch (🥉 24 · ⭐ 2.5K · 💤 ) - Pretrained Pytorch face detection (MTCNN) and facial.. MIT
vidgear (🥉 24 · ⭐ 2K) - A High-performance cross-platform Video Processing Python framework.. Apache-2
Image Super-Resolution (🥉 23 · ⭐ 3.3K) - Super-scale your images and run experiments with.. Apache-2
-
GitHub (
👨💻 10 ·🔀 570 ·📦 67 ·📋 190 - 42% open ·⏱️ 02.06.2021):git clone https://github.com/idealo/image-super-resolution
-
PyPi (
📥 2.9K / month ·📦 8 ·⏱️ 08.01.2020):pip install ISR
-
Docker Hub (
📥 190 ·⏱️ 01.04.2019):docker pull idealo/image-super-resolution-gpu
layout-parser (🥉 23 · ⭐ 2.7K) - A Unified Toolkit for Deep Learning Based Document Image.. Apache-2
tensorflow-graphics (🥉 23 · ⭐ 2.6K) - TensorFlow Graphics: Differentiable Graphics Layers.. Apache-2
CellProfiler (🥉 23 · ⭐ 630) - An open-source application for biological image analysis. BSD-3
vit-pytorch (🥉 22 · ⭐ 7K) - Implementation of Vision Transformer, a simple way to achieve.. MIT
Torch Points 3D (🥉 22 · ⭐ 1.6K) - Pytorch framework for doing deep learning on point clouds. BSD-3
pytorchvideo (🥉 20 · ⭐ 2.1K) - A deep learning library for video understanding research. Apache-2
Classy Vision (🥉 20 · ⭐ 1.4K) - An end-to-end PyTorch framework for image and video.. MIT
Norfair (🥉 20 · ⭐ 1.1K) - Lightweight Python library for adding real-time object tracking to any.. BSD-3
PaddleDetection (🥉 19 · ⭐ 5.7K) - Object Detection toolkit based on PaddlePaddle. It.. Apache-2
-
GitHub (
👨💻 75 ·🔀 1.4K ·📦 6 ·📋 2.7K - 28% open ·⏱️ 09.12.2021):git clone https://github.com/PaddlePaddle/PaddleDetection
image-match (🥉 19 · ⭐ 2.7K) - Quickly search over billions of images. Apache-2
DE⫶TR (🥉 16 · ⭐ 8K) - End-to-End Object Detection with Transformers. Apache-2
-
GitHub (
👨💻 24 ·🔀 1.4K ·📋 400 - 32% open ·⏱️ 18.10.2021):git clone https://github.com/facebookresearch/detr
PySlowFast (🥉 15 · ⭐ 4.4K) - PySlowFast: video understanding codebase from FAIR for.. Apache-2
-
GitHub (
👨💻 26 ·🔀 840 ·📦 5 ·📋 470 - 50% open ·⏱️ 28.10.2021):git clone https://github.com/facebookresearch/SlowFast
pycls (🥉 15 · ⭐ 1.8K) - Codebase for Image Classification Research, written in PyTorch. MIT
-
GitHub (
👨💻 13 ·🔀 200 ·📦 4 ·📋 76 - 27% open ·⏱️ 19.08.2021):git clone https://github.com/facebookresearch/pycls
Show 10 hidden projects...
- imgaug (
🥇 32 ·⭐ 12K ·💀 ) - Image augmentation for machine learning experiments.MIT
- glfw (
🥈 31 ·⭐ 8.4K) - A multi-platform library for OpenGL, OpenGL ES, Vulkan, window and input.❗️Zlib
- chainercv (
🥉 25 ·⭐ 1.5K ·💀 ) - ChainerCV: a Library for Deep Learning in Computer Vision.MIT
- segmentation_models (
🥉 23 ·⭐ 3.6K ·💀 ) - Segmentation models with pretrained backbones. Keras..MIT
- Image Deduplicator (
🥉 22 ·⭐ 3.9K ·💀 ) - Finding duplicate images made easy!.Apache-2
- Pillow-SIMD (
🥉 22 ·⭐ 1.7K ·💀 ) - The friendly PIL fork.❗️PIL
- PyTorch3D (
🥉 21 ·⭐ 5.5K) - PyTorch3D is FAIR's library of reusable components for..❗Unlicensed
- nude.py (
🥉 21 ·⭐ 820 ·💀 ) - Nudity detection with Python.MIT
- Luminoth (
🥉 20 ·⭐ 2.4K ·💀 ) - Deep Learning toolkit for Computer Vision.BSD-3
- solt (
🥉 17 ·⭐ 250 ·💀 ) - Streaming over lightweight data transformations.MIT
Graph Data
Libraries for graph processing, clustering, embedding, and machine learning tasks.
PyTorch Geometric (🥇 29 · ⭐ 13K) - Graph Neural Network Library for PyTorch. MIT
dgl (🥇 29 · ⭐ 8.6K) - Python package built to ease deep learning on graph, on top of existing.. Apache-2
StellarGraph (🥈 26 · ⭐ 2.2K) - StellarGraph - Machine Learning on Graphs. Apache-2
ogb (🥈 25 · ⭐ 1.2K · 📈 ) - Benchmark datasets, data loaders, and evaluators for graph machine learning. MIT
pygraphistry (🥈 22 · ⭐ 1.5K) - PyGraphistry is a Python library to quickly load, shape,.. BSD-3
Paddle Graph Learning (🥈 21 · ⭐ 1.2K) - Paddle Graph Learning (PGL) is an efficient and.. Apache-2
AmpliGraph (🥈 20 · ⭐ 1.7K · 💤 ) - Python library for Representation Learning on Knowledge.. Apache-2
pytorch_geometric_temporal (🥈 20 · ⭐ 1.2K) - PyTorch Geometric Temporal: Spatiotemporal Signal.. MIT
torch-cluster (🥈 20 · ⭐ 450) - PyTorch Extension Library of Optimized Graph Cluster.. MIT
PyTorch-BigGraph (🥉 19 · ⭐ 3K) - Generate embeddings from large-scale graph-structured.. BSD-3
graph-nets (🥉 18 · ⭐ 5K · 💤 ) - Build Graph Nets in Tensorflow. Apache-2
OpenKE (🥉 13 · ⭐ 2.8K · 💤 ) - An Open-Source Package for Knowledge Embedding (KE). MIT
-
GitHub (
👨💻 10 ·🔀 830 ·📋 380 - 18% open ·⏱️ 06.04.2021):git clone https://github.com/thunlp/OpenKE
Show 12 hidden projects...
- pygal (
🥇 27 ·⭐ 2.4K) - PYthon svg GrAph plotting Library.❗️LGPL-3.0
- igraph (
🥇 27 ·⭐ 900) - Python interface for igraph.❗️GPL-2.0
- Karate Club (
🥈 23 ·⭐ 1.5K) - Karate Club: An API Oriented Open-source Python Framework for..❗️GPL-3.0
- DeepWalk (
🥈 20 ·⭐ 2.4K ·💀 ) - DeepWalk - Deep Learning for Graphs.❗️GPL-3.0
- DIG (
🥉 17 ·⭐ 970) - A library for graph deep learning research.❗️GPL-3.0
- DeepGraph (
🥉 17 ·⭐ 250) - Analyze Data with Pandas-based Networks. Documentation:.BSD-3
- GraphEmbedding (
🥉 16 ·⭐ 2.4K ·💀 ) - Implementation and experiments of graph embedding..MIT
- Sematch (
🥉 16 ·⭐ 370 ·💀 ) - semantic similarity framework for knowledge graph.Apache-2
- pyRDF2Vec (
🥉 16 ·⭐ 140) - Python Implementation and Extension of RDF2Vec.MIT
- Euler (
🥉 14 ·⭐ 2.7K ·💀 ) - A distributed graph deep learning framework.Apache-2
- GraphSAGE (
🥉 13 ·⭐ 2.6K ·💀 ) - Representation learning on large graphs using stochastic..MIT
- OpenNE (
🥉 13 ·⭐ 1.5K ·💀 ) - An Open-Source Package for Network Embedding (NE).MIT
Audio Data
Libraries for audio analysis, manipulation, transformation, and extraction, as well as speech recognition and music generation tasks.
torchaudio (🥈 27 · ⭐ 1.5K) - Data manipulation and transformation for audio signal.. BSD-2
audioread (🥈 27 · ⭐ 380) - cross-library (GStreamer + Core Audio + MAD + FFmpeg) audio decoding.. MIT
pyAudioAnalysis (🥈 26 · ⭐ 4.3K) - Python Audio Analysis Library: Feature Extraction,.. Apache-2
python_speech_features (🥈 25 · ⭐ 2K · 💤 ) - This library provides common speech features for ASR.. MIT
python-soundfile (🥈 25 · ⭐ 430) - SoundFile is an audio library based on libsndfile, CFFI, and.. BSD-3
DeepSpeech (🥉 23 · ⭐ 18K) - DeepSpeech is an open source embedded (offline, on-device).. MPL-2.0
speechbrain (🥉 23 · ⭐ 3.4K) - A PyTorch-based Speech Toolkit. Apache-2
audiomentations (🥉 22 · ⭐ 790) - A Python library for audio data augmentation. Inspired by.. MIT
tinytag (🥉 22 · ⭐ 490) - Read music meta data and length of MP3, OGG, OPUS, MP4, M4A, FLAC, WMA and.. MIT
TTS (🥉 18 · ⭐ 5.4K · 💤 ) - Deep learning for Text to Speech (Discussion forum:.. MPL-2.0
-
GitHub (
👨💻 56 ·🔀 840 ·📥 1.5K ·📋 520 - 2% open ·⏱️ 12.02.2021):git clone https://github.com/mozilla/TTS
Show 6 hidden projects...
- SpeechRecognition (
🥇 29 ·⭐ 6K ·💀 ) - Speech recognition module for Python, supporting several..BSD-3
- aubio (
🥈 26 ·⭐ 2.6K ·💤 ) - a library for audio and music analysis.❗️GPL-3.0
- Essentia (
🥉 24 ·⭐ 2K) - C++ library for audio and music analysis, description and..❗️AGPL-3.0
- Dejavu (
🥉 20 ·⭐ 5.6K ·💀 ) - Audio fingerprinting and recognition in Python.MIT
- Julius (
🥉 18 ·⭐ 240) - Fast PyTorch based DSP for audio and 1D signals.MIT
- Muda (
🥉 17 ·⭐ 200 ·💤 ) - A library for augmenting annotated audio data.ISC
Geospatial Data
Libraries to load, process, analyze, and write geographic data as well as libraries for spatial analysis, map visualization, and geocoding.
pydeck (🥇 34 · ⭐ 9.3K) - WebGL2 powered visualization framework. MIT
-
GitHub (
👨💻 180 ·🔀 1.7K ·📦 2K ·📋 2.3K - 5% open ·⏱️ 09.12.2021):git clone https://github.com/visgl/deck.gl
-
PyPi (
📥 350K / month ·📦 2 ·⏱️ 25.10.2021):pip install pydeck
-
Conda (
📥 63K ·⏱️ 26.10.2021):conda install -c conda-forge pydeck
-
NPM (
📥 240K / month ·📦 560 ·⏱️ 25.11.2021):npm install deck.gl
ipyleaflet (🥈 29 · ⭐ 1.2K) - A Jupyter - Leaflet.js bridge. MIT
-
GitHub (
👨💻 71 ·🔀 320 ·📦 1.3K ·📋 460 - 39% open ·⏱️ 07.12.2021):git clone https://github.com/jupyter-widgets/ipyleaflet
-
PyPi (
📥 31K / month ·📦 98 ·⏱️ 06.12.2021):pip install ipyleaflet
-
Conda (
📥 780K ·⏱️ 06.12.2021):conda install -c conda-forge ipyleaflet
-
NPM (
📥 44K / month ·📦 2 ·⏱️ 06.12.2021):npm install jupyter-leaflet
ArcGIS API (🥉 26 · ⭐ 1.2K) - Documentation and samples for ArcGIS API for Python. Apache-2
-
GitHub (
👨💻 73 ·🔀 820 ·📥 950 ·📋 400 - 27% open ·⏱️ 09.12.2021):git clone https://github.com/Esri/arcgis-python-api
-
PyPi (
📥 29K / month ·📦 20 ·⏱️ 04.10.2021):pip install arcgis
-
Docker Hub (
📥 5.4K ·⭐ 33 ·⏱️ 05.10.2021):docker pull esridocker/arcgis-api-python-notebook
EarthPy (🥉 21 · ⭐ 300) - A package built to support working with spatial data using open source.. BSD-3
Show 6 hidden projects...
- Geocoder (
🥈 30 ·⭐ 1.4K ·💀 ) - Python Geocoder.MIT
- gmaps (
🥉 22 ·⭐ 720 ·💀 ) - Google maps for Jupyter notebooks.BSD-3
- Sentinelsat (
🥉 22 ·⭐ 700) - Search and download Copernicus Sentinel satellite images.❗️GPL-3.0
- geoplotlib (
🥉 21 ·⭐ 940 ·💀 ) - python toolbox for visualizing geographical data and making maps.MIT
- Satpy (
🥉 21 ·⭐ 780) - Python package for earth-observing satellite data processing.❗️GPL-3.0
- pymap3d (
🥉 19 ·⭐ 220) - pure-Python (Numpy optional) 3D coordinate conversions for geospace ecef..BSD-2
Financial Data
Libraries for algorithmic stock/crypto trading, risk analytics, backtesting, technical analysis, and other tasks on financial data.
Alpha Vantage (🥈 26 · ⭐ 3.6K) - A python wrapper for Alpha Vantage API for financial data. MIT
TensorTrade (🥉 22 · ⭐ 3.6K) - An open source reinforcement learning framework for training,.. Apache-2
Enigma Catalyst (🥉 22 · ⭐ 2.3K) - An Algorithmic Trading Library for Crypto-Assets in Python. Apache-2
stockstats (🥉 22 · ⭐ 910) - Supply a wrapper ``StockDataFrame`` based on the.. BSD-3
finmarketpy (🥉 20 · ⭐ 2.8K) - Python library for backtesting trading strategies & analyzing.. Apache-2
Crypto Signals (🥉 19 · ⭐ 3.7K) - Github.com/CryptoSignal - #1 Quant Trading & Technical Analysis.. MIT
-
GitHub (
👨💻 28 ·🔀 990 ·📋 250 - 21% open ·⏱️ 28.06.2021):git clone https://github.com/CryptoSignal/crypto-signal
-
Docker Hub (
📥 140K ·⭐ 7 ·⏱️ 03.09.2020):docker pull shadowreaver/crypto-signal
tf-quant-finance (🥉 19 · ⭐ 2.9K) - High-performance TensorFlow library for quantitative.. Apache-2
Show 10 hidden projects...
- zipline (
🥇 30 ·⭐ 15K ·💀 ) - Zipline, a Pythonic Algorithmic Trading Library.Apache-2
- backtrader (
🥈 26 ·⭐ 7.8K) - Python Backtesting library for trading strategies.❗️GPL-3.0
- pyfolio (
🥈 26 ·⭐ 4.2K ·💀 ) - Portfolio and risk analytics in Python.Apache-2
- Alphalens (
🥈 25 ·⭐ 2.1K ·💀 ) - Performance analysis of predictive (alpha) stock factors.Apache-2
- empyrical (
🥈 25 ·⭐ 870 ·💀 ) - Common financial risk and performance metrics. Used by zipline..Apache-2
- arch (
🥈 24 ·⭐ 840) - ARCH models in Python.❗️NCSA
- PyAlgoTrade (
🥉 23 ·⭐ 3.6K ·💀 ) - Python Algorithmic Trading Library.Apache-2
- FinTA (
🥉 22 ·⭐ 1.4K) - Common financial technical indicators implemented in Pandas.❗️LGPL-3.0
- Backtesting.py (
🥉 18 ·⭐ 1.9K) - Backtest trading strategies in Python.❗️AGPL-3.0
- surpriver (
🥉 12 ·⭐ 1.4K ·💀 ) - Find big moving stocks before they move using machine..❗️GPL-3.0
Time Series Data
Libraries for forecasting, anomaly detection, feature extraction, and machine learning on time-series and sequential data.
pmdarima (🥇 28 · ⭐ 1.1K) - A statistical library designed to fill the void in Python's time series.. MIT
Prophet (🥇 26 · ⭐ 14K) - Tool for producing high quality forecasts for time series data that has.. MIT
Darts (🥈 24 · ⭐ 3.2K) - A python library for easy manipulation and forecasting of time series. Apache-2
-
GitHub (
👨💻 41 ·🔀 280 ·📦 22 ·📋 280 - 36% open ·⏱️ 09.12.2021):git clone https://github.com/unit8co/darts
-
PyPi (
📥 2.2K / month ·⏱️ 28.11.2021):pip install u8darts
-
Docker Hub (
📥 200 ·⏱️ 28.11.2021):docker pull unit8/darts
pytorch-forecasting (🥈 23 · ⭐ 1.6K) - Time series forecasting with PyTorch. MIT
STUMPY (🥉 22 · ⭐ 2K) - STUMPY is a powerful and scalable Python library for modern time series.. BSD-3
Show 7 hidden projects...
- PyFlux (
🥈 23 ·⭐ 1.9K ·💀 ) - Open source time series library for Python.BSD-3
- luminol (
🥉 21 ·⭐ 980 ·💀 ) - Anomaly Detection and Correlation library.Apache-2
- pydlm (
🥉 20 ·⭐ 400 ·💀 ) - A python library for Bayesian time series modeling.BSD-3
- matrixprofile-ts (
🥉 18 ·⭐ 670 ·💀 ) - A Python library for detecting patterns and anomalies..Apache-2
- tick (
🥉 18 ·⭐ 360 ·💀 ) - Module for statistical learning, with a particular emphasis on time-..BSD-3
- ADTK (
🥉 17 ·⭐ 760 ·💀 ) - A Python toolkit for rule-based/unsupervised anomaly detection in time..MPL-2.0
- tsaug (
🥉 14 ·⭐ 220 ·💀 ) - A Python package for time series augmentation.Apache-2
Medical Data
Libraries for processing and analyzing medical data such as MRIs, EEGs, genomic data, and other medical imaging formats.
MNE (🥈 27 · ⭐ 1.8K) - MNE: Magnetoencephalography (MEG) and Electroencephalography (EEG) in Python. BSD-3
DeepVariant (🥉 21 · ⭐ 2.4K) - DeepVariant is an analysis pipeline that uses a deep neural.. BSD-3
MedicalTorch (🥉 16 · ⭐ 760 · 💤 ) - A medical imaging framework for Pytorch. Apache-2
Medical Detection Toolkit (🥉 12 · ⭐ 1.1K) - The Medical Detection Toolkit contains 2D + 3D.. Apache-2
-
GitHub (
👨💻 3 ·🔀 280 ·📋 120 - 32% open ·⏱️ 09.09.2021):git clone https://github.com/MIC-DKFZ/medicaldetectiontoolkit
Show 7 hidden projects...
- NiftyNet (
🥉 21 ·⭐ 1.3K ·💀 ) - [unmaintained] An open-source convolutional neural..Apache-2
- MedPy (
🥉 20 ·⭐ 380 ·💀 ) - Medical image processing in Python.❗️GPL-3.0
- Glow (
🥉 20 ·⭐ 180) - An open-source toolkit for large-scale genomic analysis.Apache-2
- DLTK (
🥉 19 ·⭐ 1.3K ·💀 ) - Deep Learning Toolkit for Medical Image Analysis.Apache-2
- Brainiak (
🥉 19 ·⭐ 260 ·💤 ) - Brain Imaging Analysis Kit.Apache-2
- DeepNeuro (
🥉 14 ·⭐ 110 ·💀 ) - A deep learning python package for neuroimaging data. Made by:.MIT
- MedicalNet (
🥉 12 ·⭐ 1.3K ·💀 ) - Many studies have shown that the performance on deep learning is..MIT
Tabular Data
Libraries for processing tabular and structured data.
pytorch_tabular (🥇 16 · ⭐ 490) - A standard framework for modelling Deep Learning Models.. MIT
carefree-learn (🥇 16 · ⭐ 350) - Deep Learning PyTorch. MIT
Optical Character Recognition
Libraries for optical character recognition (OCR) and text extraction from images or videos.
EasyOCR (🥇 30 · ⭐ 13K) - Ready-to-use OCR with 80+ supported languages and all popular writing.. Apache-2
Tesseract (🥇 29 · ⭐ 3.9K) - Python-tesseract is an optical character recognition (OCR) tool.. Apache-2
OCRmyPDF (🥈 26 · ⭐ 5.5K) - OCRmyPDF adds an OCR text layer to scanned PDF files, allowing them.. MPL-2.0
attention-ocr (🥉 21 · ⭐ 880) - A Tensorflow model for text recognition (CNN + seq2seq with.. MIT
Mozart (🥉 10 · ⭐ 340 · 💤 ) - An optical music recognition (OMR) system. Converts sheet.. Apache-2
-
GitHub (
👨💻 5 ·🔀 47 ·📋 9 - 33% open ·⏱️ 05.05.2021):git clone https://github.com/aashrafh/Mozart
Show 1 hidden projects...
- pdftabextract (
🥉 19 ·⭐ 2K ·💀 ) - A set of tools for extracting tables from PDF files..Apache-2
Data Containers & Structures
General-purpose data containers & structures as well as utilities & extensions for pandas.
h5py (🥇 36 · ⭐ 1.6K) - HDF5 for Python -- The h5py package is a Pythonic interface to the HDF5.. BSD-3
numexpr (🥈 31 · ⭐ 1.7K) - Fast numerical array expression evaluator for Python, NumPy, PyTables,.. MIT
Modin (🥈 29 · ⭐ 6.6K) - Modin: Speed up your Pandas workflows by changing a single line of.. Apache-2
Bottleneck (🥈 29 · ⭐ 680 · 💤 ) - Fast NumPy array functions written in C. BSD-2
datasketch (🥉 27 · ⭐ 1.6K · 📈 ) - MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog,.. MIT
Vaex (🥉 25 · ⭐ 6.8K) - Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualize and.. MIT
Pandaral·lel (🥉 25 · ⭐ 1.9K) - A simple and efficient tool to parallelize Pandas.. BSD-3
Arctic (🥉 24 · ⭐ 2.5K) - Arctic is a high performance datastore for numeric data. ❗️LGPL-2.1
Pandas Summary (🥉 22 · ⭐ 370) - A library for managing, validating, summarizing, and.. Apache-2
Show 7 hidden projects...
- Blaze (
🥈 28 ·⭐ 3K ·💀 ) - NumPy and Pandas interface to Big Data.BSD-3
- sklearn-pandas (
🥉 27 ·⭐ 2.5K ·💤 ) - Pandas integration with sklearn.❗️Zlib
- bcolz (
🥉 25 ·⭐ 930 ·💀 ) - A columnar data container that can be compressed.BSD-3
- pandasql (
🥉 24 ·⭐ 1.1K ·💀 ) - sqldf for pandas.MIT
- pickleDB (
🥉 22 ·⭐ 620 ·💀 ) - pickleDB is an open source key-value store using Python's json..BSD-3
- StaticFrame (
🥉 22 ·⭐ 260) - Immutable and grow-only Pandas-like DataFrames with a more explicit..MIT
- fletcher (
🥉 19 ·⭐ 220 ·💤 ) - Pandas ExtensionDType/Array backed by Apache Arrow.MIT
Data Loading & Extraction
Libraries for loading, collecting, and extracting data from a variety of data sources and formats.
Web Scraping & Crawling
Libraries for web scraping, crawling, downloading, and mining as well as libraries.
Data Pipelines & Streaming
Libraries for data batch- and stream-processing, workflow automation, job scheduling, and other data pipeline tasks.
Celery (🥇 39 · ⭐ 18K · 📉 ) - Asynchronous task queue/job queue based on distributed message passing. BSD-3
luigi (🥇 33 · ⭐ 15K · 📉 ) - Luigi is a Python module that helps you build complex pipelines of.. Apache-2
Airflow (🥈 32 · ⭐ 24K) - Platform to programmatically author, schedule, and monitor workflows. Apache-2
-
GitHub (
👨💻 2.2K ·🔀 9.7K ·📥 220K ·📋 4.7K - 20% open ·⏱️ 09.12.2021):git clone https://github.com/apache/airflow
-
PyPi (
📥 1.9M / month ·📦 290 ·⏱️ 15.11.2021):pip install apache-airflow
-
Conda (
📥 500K ·⏱️ 15.11.2021):conda install -c conda-forge airflow
-
Docker Hub (
📥 54M ·⭐ 300 ·⏱️ 07.12.2021):docker pull apache/airflow
dbt (🥈 30 · ⭐ 3.9K) - dbt enables data analysts and engineers to transform their data using the.. Apache-2
Kedro (🥈 26 · ⭐ 4.7K · 📉 ) - A Python framework for creating reproducible, maintainable and.. Apache-2
Activeloop (🥈 26 · ⭐ 3.9K) - Dataset format for AI. Easily build and manage datasets for.. MPL-2.0
Great Expectations (🥉 25 · ⭐ 5.8K) - Always know what to expect from your data. Apache-2
PyFunctional (🥉 25 · ⭐ 1.9K) - Python library for creating data pipelines with chain functional.. MIT
streamparse (🥉 23 · ⭐ 1.4K · 💤 ) - Run Python in Apache Storm topologies. Pythonic API, CLI.. Apache-2
ploomber (🥉 23 · ⭐ 780) - Write maintainable, production-ready pipelines using Jupyter or your.. Apache-2
Databolt Flow (🥉 20 · ⭐ 940) - Python library for building highly effective data science workflows. MIT
mrq (🥉 18 · ⭐ 860 · 💤 ) - Mr. Queue - A distributed worker task queue in Python using Redis & gevent. MIT
whylogs (🥉 18 · ⭐ 640) - Open standard for end-to-end data and ML monitoring for any scale in.. Apache-2
spark-deep-learning (🥉 17 · ⭐ 1.9K) - Deep Learning Pipelines for Apache Spark. Apache-2
-
GitHub (
👨💻 16 ·🔀 460 ·📦 19 ·📋 100 - 73% open ·⏱️ 19.08.2021):git clone https://github.com/databricks/spark-deep-learning
Mara Pipelines (🥉 17 · ⭐ 1.8K) - A lightweight opinionated ETL framework, halfway between plain.. MIT
Show 9 hidden projects...
- mrjob (
🥈 30 ·⭐ 2.6K ·💀 ) - Run MapReduce jobs on Hadoop or Amazon Web Services.Apache-2
- faust (
🥈 29 ·⭐ 5.9K ·💀 ) - Python Stream Processing.BSD-3
- pysparkling (
🥉 23 ·⭐ 240 ·💤 ) - A pure Python implementation of Apache Spark's RDD and DStream..MIT
- dbnd (
🥉 20 ·⭐ 210) - DBND is an agile pipeline framework that helps data engineering teams..Apache-2
- flupy (
🥉 19 ·⭐ 170) - Fluent data pipelines for python and your shell.MIT
- BatchFlow (
🥉 18 ·⭐ 170) - BatchFlow helps you conveniently work with random or sequential..Apache-2
- riko (
🥉 17 ·⭐ 1.6K ·💀 ) - A Python stream processing engine modeled after Yahoo! Pipes.MIT
- bodywork-core (
🥉 17 ·⭐ 310) - ML pipeline orchestration and model deployments on..❗️AGPL-3.0
- Botflow (
🥉 16 ·⭐ 1.2K ·💀 ) - Python Fast Dataflow programming framework for Data pipeline work(..BSD-3
Distributed Machine Learning
Libraries that provide capabilities to distribute and parallelize machine learning tasks across large-scale compute infrastructure.
Ray (🥇 33 · ⭐ 18K · 📈 ) - An open source framework that provides a simple, universal API for.. Apache-2
dask.distributed (🥇 32 · ⭐ 1.3K) - A distributed task scheduler for Dask. BSD-3
horovod (🥈 30 · ⭐ 12K) - Distributed training framework for TensorFlow, Keras, PyTorch, and.. Apache-2
petastorm (🥈 27 · ⭐ 1.3K) - Petastorm library enables single machine or distributed training.. Apache-2
DeepSpeed (🥈 26 · ⭐ 6K) - DeepSpeed is a deep learning optimization library that makes.. MIT
-
GitHub (
👨💻 84 ·🔀 650 ·📦 130 ·📋 740 - 49% open ·⏱️ 09.12.2021):git clone https://github.com/microsoft/DeepSpeed
-
PyPi (
📥 23K / month ·⏱️ 01.12.2021):pip install deepspeed
-
Docker Hub (
📥 12K ·⭐ 3 ·⏱️ 05.05.2021):docker pull deepspeed/deepspeed
ipyparallel (🥈 26 · ⭐ 2.1K) - IPython Parallel: Interactive Parallel Computing in Python. BSD-3
BigDL (🥈 25 · ⭐ 3.8K) - Building Large-Scale AI Applications for Distributed Big Data. Apache-2
-
GitHub (
👨💻 130 ·🔀 950 ·📦 30 ·📋 1.1K - 29% open ·⏱️ 09.12.2021):git clone https://github.com/intel-analytics/BigDL
-
PyPi (
📥 8.1K / month ·⏱️ 09.12.2021):pip install bigdl
-
Maven (
⏱️ 20.04.2021):<dependency> <groupId>com.intel.analytics.bigdl</groupId> <artifactId>bigdl-SPARK_2.4</artifactId> <version>[VERSION]</version> </dependency>
TensorFlowOnSpark (🥉 24 · ⭐ 3.7K) - TensorFlowOnSpark brings TensorFlow programs to.. Apache-2
analytics-zoo (🥉 23 · ⭐ 2.4K) - Distributed Tensorflow, Keras and PyTorch on Apache.. Apache-2
Apache Singa (🥉 19 · ⭐ 2.5K) - a distributed deep learning platform. Apache-2
-
GitHub (
👨💻 76 ·🔀 720 ·📦 1 ·📋 89 - 44% open ·⏱️ 10.08.2021):git clone https://github.com/apache/singa
-
Conda (
📥 390 ·⏱️ 09.08.2021):conda install -c nusdbsystem singa
-
Docker Hub (
📥 210 ·⭐ 4 ·⏱️ 04.06.2019):docker pull apache/singa
BytePS (🥉 18 · ⭐ 3K) - A high performance and generic framework for distributed DNN training. Apache-2
-
GitHub (
👨💻 19 ·🔀 420 ·📋 260 - 39% open ·⏱️ 12.10.2021):git clone https://github.com/bytedance/byteps
-
PyPi (
📥 33 / month ·⏱️ 02.08.2021):pip install byteps
-
Docker Hub (
📥 1.2K ·⏱️ 03.03.2020):docker pull bytepsimage/tensorflow
Show 7 hidden projects...
- DEAP (
🥈 28 ·⭐ 4.5K) - Distributed Evolutionary Algorithms in Python.❗️LGPL-3.0
- somoclu (
🥉 20 ·⭐ 230) - Massively parallel self-organizing maps: accelerate training on multicore..MIT
- TensorFrames (
🥉 19 ·⭐ 760 ·💀 ) - [DEPRECATED] Tensorflow wrapper for DataFrames on..Apache-2
- sk-dist (
🥉 19 ·⭐ 270) - Distributed scikit-learn meta-estimators in PySpark.Apache-2
- launchpad (
🥉 17 ·⭐ 240) - Launchpad is a library that simplifies writing distributed..Apache-2
- autodist (
🥉 12 ·⭐ 110 ·💤 ) - Simple Distributed Deep Learning on TensorFlow.Apache-2
- LazyCluster (
🥉 10 ·⭐ 43) - Distributed machine learning made simple.Apache-2
Hyperparameter Optimization & AutoML
Libraries for hyperparameter optimization, automl and neural architecture search.
Keras Tuner (🥇 30 · ⭐ 2.4K) - Hyperparameter tuning for humans. Apache-2
scikit-optimize (🥇 30 · ⭐ 2.2K) - Sequential model-based optimization with a `scipy.optimize`.. BSD-3
Bayesian Optimization (🥇 29 · ⭐ 5.6K · 💤 ) - A Python implementation of global optimization with.. MIT
auto-sklearn (🥈 28 · ⭐ 5.9K) - Automated Machine Learning with scikit-learn. BSD-3
featuretools (🥈 28 · ⭐ 5.9K) - An open source python library for automated feature engineering. BSD-3
mljar-supervised (🥈 25 · ⭐ 1.7K) - Python package for AutoML on Tabular Data with Feature.. MIT
Neuraxle (🥉 21 · ⭐ 490) - A Sklearn-like Framework for Hyperparameter Tuning and AutoML in.. Apache-2
Hyperactive (🥉 21 · ⭐ 320) - An optimization and data collection toolbox for convenient and fast.. MIT
Auto ViML (🥉 20 · ⭐ 310 · 📈 ) - Automatically Build Multiple ML Models with a Single Line of.. Apache-2
sklearn-deap (🥉 19 · ⭐ 670) - Use evolutionary algorithms instead of gridsearch in scikit-.. MIT
AlphaPy (🥉 18 · ⭐ 670) - Automated Machine Learning [AutoML] with Python, scikit-learn, Keras,.. Apache-2
HyperparameterHunter (🥉 15 · ⭐ 680 · 💤 ) - Easy hyperparameter optimization and automatic result.. MIT
model_search (🥉 11 · ⭐ 3.2K · 💤 ) - AutoML algorithms for model architecture search at scale. Apache-2
-
GitHub (
👨💻 1 ·🔀 300 ·📋 49 - 69% open ·⏱️ 17.03.2021):git clone https://github.com/google/model_search
Show 22 hidden projects...
- TPOT (
🥈 28 ·⭐ 8.4K ·💤 ) - A Python Automated Machine Learning tool that optimizes..❗️LGPL-3.0
- GPyOpt (
🥈 24 ·⭐ 780 ·💀 ) - Gaussian Process Optimization using GPy.BSD-3
- Orion (
🥈 24 ·⭐ 210) - Asynchronous Distributed Hyperparameter Optimization.BSD-3
- lazypredict (
🥉 22 ·⭐ 260) - Lazy Predict help build a lot of basic models without much code..MIT
- HpBandSter (
🥉 21 ·⭐ 500 ·💀 ) - a distributed Hyperband implementation on Steroids.BSD-3
- optunity (
🥉 21 ·⭐ 380 ·💀 ) - optimization routines for hyperparameter tuning.BSD-3
- MLBox (
🥉 20 ·⭐ 1.3K ·💀 ) - MLBox is a powerful Automated Machine Learning python library.❗️BSD-1-Clause
- auto_ml (
🥉 19 ·⭐ 1.6K ·💀 ) - [UNMAINTAINED] Automated machine learning for analytics & production.MIT
- Test Tube (
🥉 19 ·⭐ 700 ·💀 ) - Python library to easily log experiments and parallelize..MIT
- Dragonfly (
🥉 19 ·⭐ 610 ·💀 ) - An open source python library for scalable Bayesian optimisation.MIT
- featurewiz (
🥉 19 ·⭐ 95) - Use advanced feature engineering strategies and select best..Apache-2
- Sherpa (
🥉 18 ·⭐ 310 ·💀 ) - Hyperparameter optimization that enables researchers to..❗️GPL-3.0
- Advisor (
🥉 17 ·⭐ 1.4K ·💀 ) - Open-source implementation of Google Vizier for hyper parameters..Apache-2
- Xcessiv (
🥉 16 ·⭐ 1.3K ·💀 ) - A web-based application for quick, scalable, and automated..Apache-2
- Auto Tune Models (
🥉 16 ·⭐ 510 ·💀 ) - Auto Tune Models - A multi-tenant, multi-data system for..MIT
- Parfit (
🥉 16 ·⭐ 200 ·💀 ) - A package for parallelizing the fit and flexibly scoring of..MIT
- automl-gs (
🥉 15 ·⭐ 1.8K ·💀 ) - Provide an input CSV and a target field to predict, generate a..MIT
- Hypermax (
🥉 14 ·⭐ 97 ·💀 ) - Better, faster hyper-parameter optimization.BSD-3
- ENAS (
🥉 13 ·⭐ 2.5K ·💀 ) - PyTorch implementation of Efficient Neural Architecture Search via..Apache-2
- Auptimizer (
🥉 13 ·⭐ 180 ·💤 ) - An automatic ML model optimization tool.❗️GPL-3.0
- Devol (
🥉 11 ·⭐ 930 ·💀 ) - Genetic neural architecture search with Keras.MIT
- Hypertunity (
🥉 10 ·⭐ 120 ·💀 ) - A toolset for black-box hyperparameter optimisation.Apache-2
Reinforcement Learning
Libraries for building and evaluating reinforcement learning & agent-based systems.
OpenAI Gym (🥇 36 · ⭐ 26K) - A toolkit for developing and comparing reinforcement learning.. MIT
TensorLayer (🥈 26 · ⭐ 6.8K) - Deep Learning and Reinforcement Learning Library for.. Apache-2
TensorForce (🥈 25 · ⭐ 3.1K) - Tensorforce: a TensorFlow library for applied.. Apache-2
Stable Baselines (🥉 23 · ⭐ 3.4K) - A fork of OpenAI Baselines, implementations of reinforcement.. MIT
ChainerRL (🥉 22 · ⭐ 1K · 💤 ) - ChainerRL is a deep reinforcement learning library built on top of.. MIT
PARL (🥉 21 · ⭐ 2.3K) - A high-performance distributed training framework for Reinforcement.. Apache-2
ReAgent (🥉 17 · ⭐ 3.1K) - A platform for Reasoning systems (Reinforcement Learning,.. BSD-3
-
GitHub (
👨💻 120 ·🔀 430 ·📋 120 - 35% open ·⏱️ 08.12.2021):git clone https://github.com/facebookresearch/ReAgent
Show 4 hidden projects...
- baselines (
🥈 26 ·⭐ 12K ·💀 ) - OpenAI Baselines: high-quality implementations of reinforcement..MIT
- keras-rl (
🥈 24 ·⭐ 5.2K ·💀 ) - Deep Reinforcement Learning for Keras.MIT
- DeepMind Lab (
🥉 16 ·⭐ 6.6K) - A customisable 3D platform for agent-based AI research.❗️GPL-2.0
- Maze (
🥉 12 ·⭐ 200) - Maze Applied Reinforcement Learning Framework.❗️Custom
Recommender Systems
Libraries for building and evaluating recommendation systems.
TF Recommenders (🥈 25 · ⭐ 1.1K · 📈 ) - TensorFlow Recommenders is a library for building.. Apache-2
TF Ranking (🥈 23 · ⭐ 2.4K) - Learning to Rank in TensorFlow. Apache-2
recmetrics (🥉 20 · ⭐ 320) - A library of metrics for evaluating recommender systems. MIT
Recommenders (🥉 19 · ⭐ 12K) - Best Practices on Recommendation Systems. MIT
-
GitHub (
👨💻 100 ·🔀 2K ·📥 81 ·📦 5 ·📋 640 - 24% open ·⏱️ 23.09.2021):git clone https://github.com/microsoft/recommenders
Case Recommender (🥉 19 · ⭐ 370) - Case Recommender: A Flexible and Extensible Python.. MIT
Show 5 hidden projects...
- scikit-surprise (
🥈 25 ·⭐ 5.1K ·💀 ) - A Python scikit for building and analyzing recommender..BSD-3
- tensorrec (
🥉 20 ·⭐ 1.2K ·💀 ) - A TensorFlow recommendation algorithm and framework in..Apache-2
- Spotlight (
🥉 17 ·⭐ 2.6K ·💀 ) - Deep recommender models using PyTorch.MIT
- OpenRec (
🥉 16 ·⭐ 390 ·💀 ) - OpenRec is an open-source and modular library for neural network-..Apache-2
- lkpy (
🥉 16 ·⭐ 190) - Python recommendation toolkit.MIT
Privacy Machine Learning
Libraries for encrypted and privacy-preserving machine learning using methods like federated learning & differential privacy.
TensorFlow Privacy (🥈 23 · ⭐ 1.5K) - Library for training machine learning models with.. Apache-2
FATE (🥈 22 · ⭐ 3.7K) - An Industrial Grade Federated Learning Framework. Apache-2
-
GitHub (
👨💻 68 ·🔀 1.1K ·📋 1K - 34% open ·⏱️ 09.12.2021):git clone https://github.com/FederatedAI/FATE
Show 1 hidden projects...
- TFEncrypted (
🥉 21 ·⭐ 960 ·💀 ) - A Framework for Encrypted Machine Learning in TensorFlow.Apache-2
Workflow & Experiment Tracking
Libraries to organize, track, and visualize machine learning experiments.
Tensorboard (🥇 37 · ⭐ 5.7K) - TensorFlow's Visualization Toolkit. Apache-2
SageMaker SDK (🥇 32 · ⭐ 1.5K) - A library for training and deploying machine learning.. Apache-2
tensorboardX (🥇 31 · ⭐ 7.2K) - tensorboard for pytorch (and chainer, mxnet, numpy, ...). MIT
DVC (🥈 30 · ⭐ 9K) - Data Version Control | Git for Data & Models | ML Experiments Management. Apache-2
AzureML SDK (🥈 30 · ⭐ 2.8K) - Python notebooks with ML and deep learning examples with Azure.. MIT
wandb client (🥈 28 · ⭐ 3.6K) - A tool for visualizing and tracking your machine learning.. MIT
ClearML (🥈 27 · ⭐ 2.8K) - ClearML - Auto-Magical Suite of tools to streamline your ML.. Apache-2
-
GitHub (
👨💻 40 ·🔀 400 ·📥 380 ·📦 160 ·📋 420 - 32% open ·⏱️ 08.12.2021):git clone https://github.com/allegroai/clearml
-
PyPi (
📥 36K / month ·⏱️ 04.12.2021):pip install clearml
-
Docker Hub (
📥 30K ·⏱️ 05.10.2020):docker pull allegroai/trains
ml-metadata (🥈 25 · ⭐ 410) - For recording and retrieving metadata associated with ML.. Apache-2
livelossplot (🥉 24 · ⭐ 1.1K) - Live training loss plot in Jupyter Notebook for Keras,.. MIT
TensorWatch (🥉 21 · ⭐ 3.2K · 💤 ) - Debugging, monitoring and visualization for Python Machine.. MIT
Labml (🥉 20 · ⭐ 880) - Monitor deep learning model training and hardware usage from your mobile.. MIT
Show 12 hidden projects...
- knockknock (
🥉 22 ·⭐ 2.3K ·💀 ) - Knock Knock: Get notified when your training ends with only two..MIT
- lore (
🥉 21 ·⭐ 1.5K ·💀 ) - Lore makes machine learning approachable for Software Engineers and..MIT
- TensorBoard Logger (
🥉 21 ·⭐ 620 ·💀 ) - Log TensorBoard events without touching TensorFlow.MIT
- MXBoard (
🥉 21 ·⭐ 330 ·💀 ) - Logging MXNet data for visualization in TensorBoard.Apache-2
- hiddenlayer (
🥉 20 ·⭐ 1.6K ·💀 ) - Neural network graphs and training metrics for..MIT
- quinn (
🥉 19 ·⭐ 300 ·💤 ) - pyspark methods to enhance developer productivity.Apache-2
- gokart (
🥉 19 ·⭐ 230) - Gokart solves reproducibility, task dependencies, constraints of good code,..MIT
- SKLL (
🥉 17 ·⭐ 530) - SciKit-Learn Laboratory (SKLL) makes it easy to run machine..❗️BSD-1-Clause
- datmo (
🥉 16 ·⭐ 340 ·💀 ) - Open source production model management tool for data scientists.MIT
- steppy (
🥉 16 ·⭐ 130 ·💀 ) - Lightweight, Python library for fast and reproducible experimentation.MIT
- ModelChimp (
🥉 14 ·⭐ 120) - Experiment tracking for machine and deep learning projects.BSD-2
- traintool (
🥉 9 ·⭐ 9 ·💤 ) - Train off-the-shelf machine learning models in one..Apache-2
Model Serialization & Deployment
Libraries to serialize models to files, convert between a variety of model formats, and optimize models for deployment.
Core ML Tools (🥇 26 · ⭐ 2.5K) - Core ML tools contain supporting tools for Core ML model.. BSD-3
TorchServe (🥈 24 · ⭐ 2.3K) - Model Serving on PyTorch. Apache-2
-
GitHub (
👨💻 93 ·🔀 420 ·📥 700 ·📋 750 - 15% open ·⏱️ 06.12.2021):git clone https://github.com/pytorch/serve
-
PyPi (
📥 8.4K / month ·⏱️ 19.11.2021):pip install torchserve
-
Conda (
📥 17K ·⏱️ 19.11.2021):conda install -c pytorch torchserve
-
Docker Hub (
📥 950K ·⭐ 9 ·⏱️ 22.11.2021):docker pull pytorch/torchserve
Hummingbird (🥈 22 · ⭐ 2.7K) - Hummingbird compiles trained ML models into tensor computation for.. MIT
m2cgen (🥈 22 · ⭐ 2K) - Transform ML models into a native code (Java, C, Python, Go, JavaScript,.. MIT
pytorch2keras (🥉 18 · ⭐ 760) - PyTorch to Keras model convertor. MIT
Show 5 hidden projects...
- mmdnn (
🥈 22 ·⭐ 5.5K ·💀 ) - MMdnn is a set of tools to help users inter-operate among different deep..MIT
- huggingface_hub (
🥉 21 ·⭐ 290) - All the open source things related to the Hugging Face Hub.Apache-2
- sklearn-porter (
🥉 18 ·⭐ 1.1K ·💀 ) - Transpile trained scikit-learn estimators to C, Java,..MIT
- Larq Compute Engine (
🥉 17 ·⭐ 180) - Highly optimized inference engine for Binarized..Apache-2
- backprop (
🥉 12 ·⭐ 220 ·💤 ) - Backprop makes it simple to use, finetune, and deploy state-of-..Apache-2
Model Interpretability
Libraries to visualize, explain, debug, evaluate, and interpret machine learning models.
shap (🥇 35 · ⭐ 15K · 📉 ) - A game theoretic approach to explain the output of any machine learning.. MIT
Model Analysis (🥇 28 · ⭐ 1.1K) - Model analysis tools for TensorFlow. Apache-2
InterpretML (🥇 27 · ⭐ 4.3K) - Fit interpretable models. Explain blackbox machine learning. MIT
dtreeviz (🥇 27 · ⭐ 1.8K) - A python library for decision tree visualization and model interpretation. MIT
Fairness 360 (🥈 24 · ⭐ 1.6K) - A comprehensive set of fairness metrics for datasets and.. Apache-2
yellowbrick (🥈 23 · ⭐ 3.4K) - Visual analysis and diagnostic tools to facilitate machine.. Apache-2
explainerdashboard (🥈 23 · ⭐ 750) - Quickly build Explainable AI dashboards that show the inner.. MIT
TreeInterpreter (🥉 22 · ⭐ 690 · 💤 ) - Package for interpreting scikit-learn's decision tree.. BSD-3
Explainability 360 (🥉 21 · ⭐ 1K) - Interpretability and explainability of data and machine.. Apache-2
tf-explain (🥉 21 · ⭐ 890) - Interpretability Methods for tf.keras models with Tensorflow 2.x. MIT
random-forest-importances (🥉 21 · ⭐ 480 · 💤 ) - Code to compute permutation and drop-column.. MIT
What-If Tool (🥉 20 · ⭐ 610) - Source code/webpage/demos for the What-If Tool. Apache-2
imodels (🥉 20 · ⭐ 350) - Interpretable ML package for concise, transparent, and accurate predictive.. MIT
responsible-ai-widgets (🥉 20 · ⭐ 350) - This project provides responsible AI user interfaces.. MIT
sklearn-evaluation (🥉 20 · ⭐ 320) - Machine learning model evaluation made easy: plots,.. MIT
LIT (🥉 18 · ⭐ 2.7K) - The Language Interpretability Tool: Interactively analyze NLP models for.. Apache-2
iNNvestigate (🥉 17 · ⭐ 920) - A toolbox to iNNvestigate neural networks' predictions!. BSD-2
FlashTorch (🥉 14 · ⭐ 630 · 💤 ) - Visualization toolkit for neural networks in PyTorch! Demo --. MIT
Show 12 hidden projects...
- eli5 (
🥈 26 ·⭐ 2.5K ·💀 ) - A library for debugging/inspecting machine learning classifiers and..MIT
- scikit-plot (
🥈 25 ·⭐ 2.2K ·💀 ) - An intuitive library to add plotting functionality to..MIT
- keras-vis (
🥈 24 ·⭐ 2.9K ·💀 ) - Neural network visualization toolkit for keras.MIT
- Skater (
🥉 20 ·⭐ 1K ·💀 ) - Python Library for Model Interpretation/Explanations.❗️UPL-1.0
- DALEX (
🥉 20 ·⭐ 970) - moDel Agnostic Language for Exploration and eXplanation.❗️GPL-3.0
- fairness-indicators (
🥉 19 ·⭐ 240) - Tensorflow's Fairness Evaluation and Visualization..Apache-2
- model-card-toolkit (
🥉 18 ·⭐ 240) - a tool that leverages rich metadata and lineage..Apache-2
- interpret-text (
🥉 16 ·⭐ 290) - A library that incorporates state-of-the-art explainers for..MIT
- ExplainX.ai (
🥉 15 ·⭐ 250 ·💤 ) - Explainable AI framework for data scientists. Explain & debug any..MIT
- contextual-ai (
🥉 14 ·⭐ 73) - Contextual AI adds explainability to different stages of..Apache-2
- Attribution Priors (
🥉 13 ·⭐ 90 ·💤 ) - Tools for training explainable models using..MIT
- bias-detector (
🥉 12 ·⭐ 35) - Bias Detector is a python package for detecting bias in machine..MIT
Vector Similarity Search (ANN)
Libraries for Approximate Nearest Neighbor Search and Vector Indexing/Similarity Search.
Annoy (🥇 29 · ⭐ 9.2K) - Approximate Nearest Neighbors in C++/Python optimized for memory usage.. Apache-2
Milvus (🥇 28 · ⭐ 8.9K) - An open-source vector database for embedding similarity search and AI.. Apache-2
-
GitHub (
👨💻 180 ·🔀 1.3K ·📥 5.7K ·📋 4.1K - 5% open ·⏱️ 09.12.2021):git clone https://github.com/milvus-io/milvus
-
PyPi (
📥 9.8K / month ·📦 6 ·⏱️ 01.11.2021):pip install pymilvus
-
Docker Hub (
📥 650K ·⭐ 16 ·⏱️ 26.11.2021):docker pull milvusdb/milvus
NMSLIB (🥈 27 · ⭐ 2.6K) - Non-Metric Space Library (NMSLIB): An efficient similarity search.. Apache-2
PyNNDescent (🥈 27 · ⭐ 520) - A Python nearest neighbor descent for approximate nearest neighbors. BSD-2
Faiss (🥈 26 · ⭐ 15K) - A library for efficient similarity search and clustering of dense vectors. MIT
hnswlib (🥈 26 · ⭐ 1.8K) - Header-only C++/python library for fast approximate nearest neighbors. Apache-2
N2 (🥉 18 · ⭐ 500 · 💤 ) - TOROS N2 - lightweight approximate Nearest Neighbor library which runs.. Apache-2
Show 3 hidden projects...
Probabilistics & Statistics
Libraries providing capabilities for probabilistic programming/reasoning, bayesian inference, gaussian processes, or statistics.
tensorflow-probability (🥇 28 · ⭐ 3.5K) - Probabilistic reasoning and statistical analysis in.. Apache-2
filterpy (🥇 28 · ⭐ 2K · 💤 ) - Python Kalman filtering and optimal estimation library. Implements.. MIT
pomegranate (🥈 27 · ⭐ 2.8K) - Fast, flexible and easy to use probabilistic modelling in Python. MIT
SALib (🥉 25 · ⭐ 550) - Sensitivity Analysis Library in Python. Contains Sobol, Morris, FAST, and.. MIT
Orbit (🥉 20 · ⭐ 830) - A Python package for Bayesian forecasting with object-oriented design.. Apache-2
Baal (🥉 17 · ⭐ 480) - Library to enable Bayesian active learning in your research or labeling.. Apache-2
Show 8 hidden projects...
- pingouin (
🥉 26 ·⭐ 860) - Statistical package in Python based on Pandas.❗️GPL-3.0
- Edward (
🥉 25 ·⭐ 4.7K ·💀 ) - A probabilistic programming language in TensorFlow. Deep..Apache-2
- PyStan (
🥉 23 ·⭐ 140) - PyStan, a Python interface to Stan, a platform for statistical modeling...ISC
- scikit-posthocs (
🥉 20 ·⭐ 220) - Multiple Pairwise Comparisons (Post Hoc) Tests in Python.MIT
- pyhsmm (
🥉 19 ·⭐ 500 ·💀 ) - Bayesian inference in HSMMs and HMMs.MIT
- Funsor (
🥉 19 ·⭐ 180) - Functional tensors for probabilistic programming.Apache-2
- ZhuSuan (
🥉 14 ·⭐ 2.1K ·💀 ) - A probabilistic programming library for Bayesian deep learning,..MIT
- Lea (
🥉 12 ·📈 ) - Discrete probability distributions in Python.❗️GPL-3.0
Adversarial Robustness
Libraries for testing the robustness of machine learning models against attacks with adversarial/malicious examples.
CleverHans (🥇 28 · ⭐ 5.3K) - An adversarial example library for constructing attacks,.. MIT
Foolbox (🥈 26 · ⭐ 2.1K) - A Python toolbox to create adversarial examples that fool neural networks.. MIT
TextAttack (🥈 26 · ⭐ 1.8K) - TextAttack is a Python framework for adversarial attacks, data.. MIT
ART (🥈 23 · ⭐ 2.6K) - Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning.. MIT
robustness (🥉 18 · ⭐ 630) - A library for experimenting with, training and evaluating neural.. MIT
AdvBox (🥉 17 · ⭐ 1.2K · 💤 ) - Advbox is a toolbox to generate adversarial examples that fool.. Apache-2
Show 3 hidden projects...
GPU Utilities
Libraries that require and make use of CUDA/GPU system capabilities to optimize data handling and machine learning tasks.
CuPy (🥇 32 · ⭐ 5.6K) - NumPy & SciPy for GPU. MIT
-
GitHub (
👨💻 290 ·🔀 530 ·📥 23K ·📦 890 ·📋 1.6K - 22% open ·⏱️ 09.12.2021):git clone https://github.com/cupy/cupy
-
PyPi (
📥 58K / month ·📦 190 ·⏱️ 09.12.2021):pip install cupy
-
Conda (
📥 1.1M ·⏱️ 12.11.2021):conda install -c conda-forge cupy
-
Docker Hub (
📥 53K ·⭐ 7 ·⏱️ 09.12.2021):docker pull cupy/cupy
scikit-cuda (🥈 22 · ⭐ 870) - Python interface to GPU-powered libraries. BSD-3
DALI (🥉 17 · ⭐ 3.6K) - A GPU-accelerated library containing highly optimized building blocks.. Apache-2
-
GitHub (
👨💻 68 ·🔀 450 ·📋 1.1K - 13% open ·⏱️ 09.12.2021):git clone https://github.com/NVIDIA/DALI
BlazingSQL (🥉 17 · ⭐ 1.6K) - BlazingSQL is a lightweight, GPU accelerated, SQL engine for.. Apache-2
Vulkan Kompute (🥉 17 · ⭐ 620) - General purpose GPU compute framework for cross vendor.. Apache-2
cuSignal (🥉 14 · ⭐ 550) - GPU accelerated signal processing. Apache-2
-
GitHub (
👨💻 36 ·🔀 79 ·📋 120 - 12% open ·⏱️ 08.12.2021):git clone https://github.com/rapidsai/cusignal
Show 5 hidden projects...
- GPUtil (
🥈 23 ·⭐ 800 ·💀 ) - A Python module for getting the GPU status from NVIDA GPUs using..MIT
- py3nvml (
🥈 23 ·⭐ 200) - Python 3 Bindings for NVML library. Get NVIDIA GPU status inside your..BSD-3
- nvidia-ml-py3 (
🥉 21 ·⭐ 71 ·💀 ) - Python 3 Bindings for the NVIDIA Management Library.BSD-3
- SpeedTorch (
🥉 16 ·⭐ 640 ·💀 ) - Library for faster pinned CPU - GPU transfer in Pytorch.MIT
- ipyexperiments (
🥉 16 ·⭐ 140 ·📈 ) - jupyter/ipython experiment containers for GPU and..Apache-2
Tensorflow Utilities
Libraries that extend TensorFlow with additional capabilities.
tensor2tensor (🥇 32 · ⭐ 12K) - Library of deep learning models and datasets designed to.. Apache-2
TensorFlow Datasets (🥈 31 · ⭐ 3.1K) - TFDS is a collection of datasets ready to use with.. Apache-2
tensorflow-hub (🥈 31 · ⭐ 3K) - A library for transfer learning by reusing parts of.. Apache-2
TF Model Optimization (🥈 29 · ⭐ 1.2K) - A toolkit to optimize ML models for deployment for.. Apache-2
Keras-Preprocessing (🥈 29 · ⭐ 1K · 💤 ) - Utilities for working with image data, text data, and.. MIT
TensorFlow Transform (🥈 29 · ⭐ 900) - Input pipeline framework. Apache-2
TensorFlow I/O (🥉 24 · ⭐ 520) - Dataset, streaming, and file system extensions.. Apache-2
TensorFlow Cloud (🥉 24 · ⭐ 320) - The TensorFlow Cloud repository provides APIs that.. Apache-2
efficientnet (🥉 23 · ⭐ 1.9K) - Implementation of EfficientNet model. Keras and.. Apache-2
Neural Structured Learning (🥉 23 · ⭐ 890) - Training neural models with structured signals. Apache-2
TensorNets (🥉 19 · ⭐ 1K · 💤 ) - High level network definitions with pre-trained weights in.. MIT
TF Compression (🥉 17 · ⭐ 550) - Data compression in TensorFlow. Apache-2
Show 1 hidden projects...
Sklearn Utilities
Libraries that extend scikit-learn with additional capabilities.
imbalanced-learn (🥇 32 · ⭐ 5.6K) - A Python Package to Tackle the Curse of Imbalanced.. MIT
category_encoders (🥈 30 · ⭐ 1.8K) - A library of sklearn compatible categorical variable.. BSD-3
fancyimpute (🥈 25 · ⭐ 1K) - Multivariate imputation and matrix completion algorithms.. Apache-2
sklearn-contrib-lightning (🥈 23 · ⭐ 1.5K) - Large-scale linear classification, regression and.. BSD-3
-
GitHub (
👨💻 17 ·🔀 190 ·📥 100 ·📦 96 ·📋 90 - 55% open ·⏱️ 15.06.2021):git clone https://github.com/scikit-learn-contrib/lightning
-
PyPi (
📥 1.2K / month ·📦 10 ·⏱️ 15.06.2021):pip install sklearn-contrib-lightning
-
Conda (
📥 160K ·⏱️ 13.11.2021):conda install -c conda-forge sklearn-contrib-lightning
iterative-stratification (🥈 23 · ⭐ 610) - scikit-learn cross validators for iterative.. BSD-3
scikit-opt (🥉 22 · ⭐ 2.8K) - Genetic Algorithm, Particle Swarm Optimization, Simulated.. MIT
scikit-lego (🥉 21 · ⭐ 650) - Extra blocks for scikit-learn pipelines. MIT
scikit-tda (🥉 20 · ⭐ 320) - Topological Data Analysis for Python. MIT
Show 6 hidden projects...
- sklearn-crfsuite (
🥈 24 ·⭐ 380 ·💀 ) - scikit-learn inspired API for CRFsuite.MIT
- scikit-multilearn (
🥉 22 ·⭐ 700 ·💀 ) - A scikit-learn based module for multi-label et. al...BSD-2
- skope-rules (
🥉 20 ·⭐ 420 ·💀 ) - machine learning with logical rules in Python.❗️BSD-1-Clause
- skggm (
🥉 18 ·⭐ 190 ·💤 ) - Scikit-learn compatible estimation of general graphical models.MIT
- celer (
🥉 17 ·⭐ 130) - Fast solver for L1-type problems: Lasso, sparse Logisitic regression,..BSD-3
- dabl (
🥉 15 ·⭐ 110) - Data Analysis Baseline Library.BSD-3
Pytorch Utilities
Libraries that extend Pytorch with additional capabilities.
PML (🥇 27 · ⭐ 3.9K) - The easiest way to use deep metric learning in your application. Modular,.. MIT
pytorch-optimizer (🥇 27 · ⭐ 2.2K) - torch-optimizer -- collection of optimizers for.. Apache-2
EfficientNet-PyTorch (🥇 26 · ⭐ 6.7K · 💤 ) - A PyTorch implementation of EfficientNet and.. Apache-2
pytorch-summary (🥇 26 · ⭐ 3.3K · 💤 ) - Model summary in PyTorch similar to `model.summary()`.. MIT
accelerate (🥈 24 · ⭐ 2K) - A simple way to train and use PyTorch models with multi-GPU,.. Apache-2
lightning-flash (🥈 23 · ⭐ 1.3K) - Your PyTorch AI Factory - Flash enables you to easily.. Apache-2
torchdiffeq (🥈 22 · ⭐ 3.8K) - Differentiable ODE solvers with full GPU support and.. MIT
SRU (🥈 22 · ⭐ 2K · 💤 ) - Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755). MIT
reformer-pytorch (🥈 22 · ⭐ 1.6K) - Reformer, the efficient Transformer, in Pytorch. MIT
EfficientNets (🥈 22 · ⭐ 1.4K) - Pretrained EfficientNet, EfficientNet-Lite, MixNet,.. Apache-2
torch-scatter (🥈 22 · ⭐ 830) - PyTorch Extension Library of Optimized Scatter Operations. MIT
PyTorch Sparse (🥈 22 · ⭐ 540) - PyTorch Extension Library of Optimized Autograd Sparse.. MIT
Pytorch Toolbelt (🥉 20 · ⭐ 1.2K) - PyTorch extensions for fast R&D prototyping and Kaggle.. MIT
Tensor Sensor (🥉 19 · ⭐ 600) - The goal of this library is to generate more helpful.. MIT
Performer Pytorch (🥉 18 · ⭐ 750) - An implementation of Performer, a linear attention-based.. MIT
tinygrad (🥉 16 · ⭐ 5.1K) - You like pytorch? You like micrograd? You love tinygrad!. MIT
-
GitHub (
👨💻 52 ·🔀 570 ·📦 1 ·📋 100 - 20% open ·⏱️ 30.11.2021):git clone https://github.com/geohot/tinygrad
torchsde (🥉 15 · ⭐ 880) - Differentiable SDE solvers with GPU support and efficient.. Apache-2
-
GitHub (
👨💻 5 ·🔀 94 ·📦 9 ·📋 41 - 17% open ·⏱️ 26.07.2021):git clone https://github.com/google-research/torchsde
Torch-Struct (🥉 14 · ⭐ 1K) - Fast, general, and tested differentiable structured prediction.. MIT
-
GitHub (
👨💻 13 ·🔀 76 ·📋 49 - 42% open ·⏱️ 04.11.2021):git clone https://github.com/harvardnlp/pytorch-struct
Show 7 hidden projects...
- pretrainedmodels (
🥇 28 ·⭐ 8.3K ·💀 ) - Pretrained ConvNets for pytorch: NASNet, ResNeXt,..BSD-3
- Poutyne (
🥉 20 ·⭐ 510) - A simplified framework and utilities for PyTorch.❗️LGPL-3.0
- AdaBound (
🥉 19 ·⭐ 2.9K ·💀 ) - An optimizer that trains as fast as Adam and as good as SGD.Apache-2
- Antialiased CNNs (
🥉 18 ·⭐ 1.5K) - pip install antialiased-cnns to improve stability and..❗️CC BY-NC-SA 4.0
- Lambda Networks (
🥉 16 ·⭐ 1.5K ·💀 ) - Implementation of LambdaNetworks, a new approach to..MIT
- micrograd (
🥉 14 ·⭐ 1.8K ·💀 ) - A tiny scalar-valued autograd engine and a neural net library..MIT
- TorchDrift (
🥉 14 ·⭐ 180) - Drift Detection for your PyTorch Models.Apache-2
Database Clients
Libraries for connecting to, operating, and querying databases.
Others
metric-learn (🥈 25 · ⭐ 1.2K) - Metric learning algorithms in Python. MIT
TabPy (🥈 25 · ⭐ 1.2K) - Execute Python code on the fly and display results in Tableau visualizations:. MIT
PennyLane (🥈 25 · ⭐ 1.1K) - PennyLane is a cross-platform Python library for differentiable.. Apache-2
pyclustering (🥈 25 · ⭐ 900 · 💤 ) - pyclustring is a Python, C++ data mining library. BSD-3
pyjanitor (🥈 25 · ⭐ 780) - Clean APIs for data cleaning. Python implementation of R package Janitor. MIT
alibi-detect (🥉 23 · ⭐ 980) - Algorithms for outlier, adversarial and drift detection. Apache-2
StreamAlert (🥉 20 · ⭐ 2.6K) - StreamAlert is a serverless, realtime data analysis framework.. Apache-2
-
GitHub (
👨💻 33 ·🔀 320 ·📋 340 - 24% open ·⏱️ 04.11.2021):git clone https://github.com/airbnb/streamalert
scikit-rebate (🥉 20 · ⭐ 330 · 💤 ) - A scikit-learn-compatible Python implementation of.. MIT
River (🥉 19 · ⭐ 3K) - Online machine learning in Python. BSD-3
-
GitHub (
👨💻 70 ·🔀 320 ·📦 51 ·📋 330 - 2% open ·⏱️ 07.12.2021):git clone https://github.com/online-ml/river
apricot (🥉 19 · ⭐ 380) - apricot implements submodular optimization for the purpose of selecting.. MIT
opyrator (🥉 18 · ⭐ 2.5K · 💤 ) - Turns your machine learning code into microservices with web API,.. MIT
avalanche (🥉 18 · ⭐ 680) - Avalanche: an End-to-End Library for Continual Learning. MIT
-
GitHub (
👨💻 46 ·🔀 100 ·📋 440 - 15% open ·⏱️ 01.12.2021):git clone https://github.com/ContinualAI/avalanche
traingenerator (🥉 12 · ⭐ 1.1K · 💤 ) - A web app to generate template code for machine learning. MIT
-
GitHub (
👨💻 3 ·🔀 160 ·📋 16 - 81% open ·⏱️ 29.04.2021):git clone https://github.com/jrieke/traingenerator
Show 13 hidden projects...
- Cython BLIS (
🥇 28 ·⭐ 180) - Fast matrix-multiplication as a self-contained Python library no..BSD-3
- pysc2 (
🥈 25 ·⭐ 7.4K ·💀 ) - StarCraft II Learning Environment.Apache-2
- datalad (
🥉 24 ·⭐ 270) - Keep code, data, containers under control with git and git-annex.MIT
- minisom (
🥉 22 ·⭐ 970) - MiniSom is a minimalistic implementation of the Self Organizing..❗️CC-BY-3.0
- impyute (
🥉 21 ·⭐ 300) - Data imputations library to preprocess datasets with missing data.MIT
- cleanlab (
🥉 20 ·⭐ 2.5K) - The standard package for machine learning with noisy labels,..❗️AGPL-3.0
- mlens (
🥉 20 ·⭐ 710 ·💀 ) - ML-Ensemble high performance ensemble learning.MIT
- rrcf (
🥉 20 ·⭐ 350 ·💀 ) - Implementation of the Robust Random Cut Forest algorithm for anomaly..MIT
- vecstack (
🥉 19 ·⭐ 640 ·💀 ) - Python package for stacking (machine learning technique).MIT
- pandas-ml (
🥉 19 ·⭐ 280 ·💀 ) - pandas, scikit-learn, xgboost and seaborn integration.BSD-3
- Feature Engine (
🥉 16 ·⭐ 9) - Feature engineering package with sklearn like functionality.BSD-3
- dstack (
🥉 12 ·⭐ 180) - An open-source tool to rapidly develop data applications with Python.Apache-2
- nylon (
🥉 11 ·⭐ 76 ·🐣 ) - An intelligent, flexible grammar of machine learning.MIT
Related Resources
- Papers With Code: Discover ML papers, code, and evaluation tables.
- Sotabench: Discover & compare open-source ML models.
- Google Dataset Search: Dataset search engine by Google.
- Dataset List: List of the biggest ML datasets from across the web.
- Awesome Public Datasets: A topic-centric list of open datasets.
- Best-of lists: Discover other best-of lists with awesome open-source projects on all kinds of topics.
- best-of-python-dev: A ranked list of awesome python developer tools and libraries.
- best-of-web-python: A ranked list of awesome python libraries for web development.
Contribution
Contributions are encouraged and always welcome! If you like to add or update projects, choose one of the following ways:
- Open an issue by selecting one of the provided categories from the issue page and fill in the requested information.
- Modify the projects.yaml with your additions or changes, and submit a pull request. This can also be done directly via the Github UI.
If you like to contribute to or share suggestions regarding the project metadata collection or markdown generation, please refer to the best-of-generator repository. If you like to create your own best-of list, we recommend to follow this guide.
For more information on how to add or update projects, please read the contribution guidelines. By participating in this project, you agree to abide by its Code of Conduct.