All Projects β†’ nanxstats β†’ stackgbm

nanxstats / stackgbm

Licence: other
🌳 Stacked Gradient Boosting Machines

Programming Languages

r
7636 projects

Projects that are alternatives of or similar to stackgbm

Lightgbm
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
Stars: ✭ 13,293 (+55287.5%)
Mutual labels:  gbdt, gbm, lightgbm, decision-trees, gradient-boosting
HyperGBM
A full pipeline AutoML tool for tabular data
Stars: ✭ 172 (+616.67%)
Mutual labels:  xgboost, gbm, lightgbm, ensemble-learning, catboost
Awesome Decision Tree Papers
A collection of research papers on decision, classification and regression trees with implementations.
Stars: ✭ 1,908 (+7850%)
Mutual labels:  xgboost, lightgbm, ensemble-learning, gradient-boosting, catboost
fast retraining
Show how to perform fast retraining with LightGBM in different business cases
Stars: ✭ 56 (+133.33%)
Mutual labels:  xgboost, gbdt, gbm, lightgbm
RobustTrees
[ICML 2019, 20 min long talk] Robust Decision Trees Against Adversarial Examples
Stars: ✭ 62 (+158.33%)
Mutual labels:  xgboost, gbdt, gbm, decision-trees
aws-machine-learning-university-dte
Machine Learning University: Decision Trees and Ensemble Methods
Stars: ✭ 119 (+395.83%)
Mutual labels:  xgboost, lightgbm, decision-trees, catboost
decision-trees-for-ml
Building Decision Trees From Scratch In Python
Stars: ✭ 61 (+154.17%)
Mutual labels:  xgboost, gbm, lightgbm, gradient-boosting
JLBoost.jl
A 100%-Julia implementation of Gradient-Boosting Regression Tree algorithms
Stars: ✭ 65 (+170.83%)
Mutual labels:  xgboost, gbdt, lightgbm, catboost
handson-ml
λ„μ„œ "ν•Έμ¦ˆμ˜¨ λ¨Έμ‹ λŸ¬λ‹"의 μ˜ˆμ œμ™€ μ—°μŠ΅λ¬Έμ œλ₯Ό 담은 μ£Όν”Όν„° λ…ΈνŠΈλΆμž…λ‹ˆλ‹€.
Stars: ✭ 285 (+1087.5%)
Mutual labels:  xgboost, ensemble-learning, gradient-boosting
datascienv
datascienv is package that helps you to setup your environment in single line of code with all dependency and it is also include pyforest that provide single line of import all required ml libraries
Stars: ✭ 53 (+120.83%)
Mutual labels:  xgboost, lightgbm, catboost
Predicting real estate prices using scikit Learn
Predicting Amsterdam house / real estate prices using Ordinary Least Squares-, XGBoost-, KNN-, Lasso-, Ridge-, Polynomial-, Random Forest-, and Neural Network MLP Regression (via scikit-learn)
Stars: ✭ 78 (+225%)
Mutual labels:  xgboost, ensemble-learning, decision-trees
Auto ml
[UNMAINTAINED] Automated machine learning for analytics & production
Stars: ✭ 1,559 (+6395.83%)
Mutual labels:  xgboost, lightgbm, gradient-boosting
recsys2019
The complete code and notebooks used for the ACM Recommender Systems Challenge 2019
Stars: ✭ 26 (+8.33%)
Mutual labels:  xgboost, lightgbm, catboost
Apartment-Interest-Prediction
Predict people interest in renting specific NYC apartments. The challenge combines structured data, geolocalization, time data, free text and images.
Stars: ✭ 17 (-29.17%)
Mutual labels:  xgboost, lightgbm, gradient-boosting
Kaggle-Competition-Sberbank
Top 1% rankings (22/3270) code sharing for Kaggle competition Sberbank Russian Housing Market: https://www.kaggle.com/c/sberbank-russian-housing-market
Stars: ✭ 31 (+29.17%)
Mutual labels:  xgboost, lightgbm, ensemble-learning
AutoTabular
Automatic machine learning for tabular data. ⚑πŸ”₯⚑
Stars: ✭ 51 (+112.5%)
Mutual labels:  xgboost, lightgbm, catboost
lleaves
Compiler for LightGBM gradient-boosted trees, based on LLVM. Speeds up prediction by β‰₯10x.
Stars: ✭ 132 (+450%)
Mutual labels:  lightgbm, decision-trees, gradient-boosting
Xgboost
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
Stars: ✭ 22,017 (+91637.5%)
Mutual labels:  xgboost, gbdt, gbm
Leaves
pure Go implementation of prediction part for GBRT (Gradient Boosting Regression Trees) models from popular frameworks
Stars: ✭ 261 (+987.5%)
Mutual labels:  xgboost, lightgbm, decision-trees
Awesome Gradient Boosting Papers
A curated list of gradient boosting research papers with implementations.
Stars: ✭ 704 (+2833.33%)
Mutual labels:  xgboost, lightgbm, gradient-boosting

stackgbm

Lifecycle: experimental

stackgbm offers a minimalist implementation of model stacking (Wolpert, 1992) for gradient boosted tree models built by xgboost (Chen and Guestrin, 2016), lightgbm (Ke et al., 2017), and catboost (Prokhorenkova et al., 2018).

Install

First, install the R package catboost which is not yet available from CRAN as of December 2020. Follow its official installation guide.

Then install stackgbm from GitHub:

remotes::install_github("nanxstats/stackgbm")

Design

stackgbm implements a classic two-layer stacking model: the first layer generates "features" produced by gradient boosting trees. The second layer is a logistic regression that uses these features as inputs. The code is derived from our 2nd place solution for a precisionFDA brain cancer machine learning challenge in 2020.

To make sure the package is easy to understand, modify, and extend, we choose to build this package with base R without any special frameworks or dialects. We also only exposed the most essential tunable parameters for the boosted tree models (learning rate, maximum depth of a tree, and number of iterations).

License

stackgbm is free and open source software, licensed under GPL-3.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].