Freemanzxp / Gbdt_simple_tutorial
Licence: apache-2.0
python实现GBDT的回归、二分类以及多分类,将算法流程详情进行展示解读并可视化,庖丁解牛地理解GBDT。Gradient Boosting Decision Trees regression, dichotomy and multi-classification are realized based on python, and the details of algorithm flow are displayed, interpreted and visualized to help readers better understand Gradient Boosting Decision
Stars: ✭ 503
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to Gbdt simple tutorial
Pyramid
Open source Machine Learning library written in Java
Stars: ✭ 172 (-65.81%)
Mutual labels: gradient-boosting
influence boosting
Supporting code for the paper "Finding Influential Training Samples for Gradient Boosted Decision Trees"
Stars: ✭ 57 (-88.67%)
Mutual labels: gradient-boosting
Infiniteboost
InfiniteBoost: building infinite ensembles with gradient descent
Stars: ✭ 180 (-64.21%)
Mutual labels: gradient-boosting
cheapml
Machine Learning algorithms coded from scratch
Stars: ✭ 17 (-96.62%)
Mutual labels: gradient-boosting
Apartment-Interest-Prediction
Predict people interest in renting specific NYC apartments. The challenge combines structured data, geolocalization, time data, free text and images.
Stars: ✭ 17 (-96.62%)
Mutual labels: gradient-boosting
Shap
A game theoretic approach to explain the output of any machine learning model.
Stars: ✭ 14,917 (+2865.61%)
Mutual labels: gradient-boosting
Drishti
Real time eye tracking for embedded and mobile devices.
Stars: ✭ 325 (-35.39%)
Mutual labels: gradient-boosting
orderbook modeling
Example of order book modeling.
Stars: ✭ 38 (-92.45%)
Mutual labels: gradient-boosting
yggdrasil-decision-forests
A collection of state-of-the-art algorithms for the training, serving and interpretation of Decision Forest models.
Stars: ✭ 156 (-68.99%)
Mutual labels: gradient-boosting
Lightautoml
LAMA - automatic model creation framework
Stars: ✭ 196 (-61.03%)
Mutual labels: gradient-boosting
autogbt-alt
An experimental Python package that reimplements AutoGBT using LightGBM and Optuna.
Stars: ✭ 76 (-84.89%)
Mutual labels: gradient-boosting
Chefboost
A Lightweight Decision Tree Framework supporting regular algorithms: ID3, C4,5, CART, CHAID and Regression Trees; some advanced techniques: Gradient Boosting (GBDT, GBRT, GBM), Random Forest and Adaboost w/categorical features support for Python
Stars: ✭ 176 (-65.01%)
Mutual labels: gradient-boosting
lleaves
Compiler for LightGBM gradient-boosted trees, based on LLVM. Speeds up prediction by ≥10x.
Stars: ✭ 132 (-73.76%)
Mutual labels: gradient-boosting
Lightgbm
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
Stars: ✭ 13,293 (+2542.74%)
Mutual labels: gradient-boosting
handson-ml
도서 "핸즈온 머신러닝"의 예제와 연습문제를 담은 주피터 노트북입니다.
Stars: ✭ 285 (-43.34%)
Mutual labels: gradient-boosting
Interpret
Fit interpretable models. Explain blackbox machine learning.
Stars: ✭ 4,352 (+765.21%)
Mutual labels: gradient-boosting
Ensemble-Pytorch
A unified ensemble framework for PyTorch to improve the performance and robustness of your deep learning model.
Stars: ✭ 407 (-19.09%)
Mutual labels: gradient-boosting
arboreto
A scalable python-based framework for gene regulatory network inference using tree-based ensemble regressors.
Stars: ✭ 33 (-93.44%)
Mutual labels: gradient-boosting
GBDT_Simple_Tutorial(梯度提升树简易教程)
简介
利用python实现GBDT算法的回归、二分类以及多分类,将算法流程详情进行展示解读并可视化,便于读者庖丁解牛地理解GBDT。
项目进度:
- [x] 回归
- [x] 二分类
- [x] 多分类
- [x] 可视化
算法原理以及公式推导请前往blog:GBDT算法原理以及实例理解
依赖环境
- 操作系统:Windows/Linux
- 编程语言:Python3
- Python库:pandas、PIL、pydotplus,
其中pydotplus库会自动调用Graphviz,所以需要去Graphviz官网下载
graphviz的-2.38.msi
,先安装,再将安装目录下的bin
添加到系统环境变量,此时如果再报错可以重启计算机。详细过程不再描述,网上很多解答。
文件结构
- | - GBDT 主模块文件夹
- | --- gbdt.py 梯度提升算法主框架
- | --- decision_tree.py 单颗树生成,包括节点划分和叶子结点生成
- | --- loss_function.py 损失函数
- | --- tree_plot.py 树的可视化
- | - example.py 回归/二分类/多分类测试文件
运行指南
-
回归测试:
python example.py --model = regression
-
二分类测试:
python example.py --model = binary_cf
-
多分类测试:
python example.py --model = multi_cf
-
其他可配置参数:
lr
-- 学习率,trees
-- 构建的决策树数量即迭代次数,
depth
-- 决策树的深度,count
-- 决策树节点分裂的最小数据数量,is_log
-- 是否打印树的生成过程,is_plot
-- 是否可视化树的结构. -
结果文件: 运行后会生成
results
文件夹,里面包含了每棵树的内部结构和生成日志
结果展示
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].