Nature-Inspired Algorithms for scikit-learn
Nature-inspired algorithms for hyper-parameter tuning of scikit-learn models. This package uses algorithms implementation from NiaPy.
Installation
$ pip install sklearn-nature-inspired-algorithmsTo install this package on Fedora, run:
$ dnf install python3-sklearn-nature-inspired-algorithmsUsage
The usage is similar to using sklearn's GridSearchCV. Refer to the documentation for more detailed guides and more examples.
from sklearn_nature_inspired_algorithms.model_selection import NatureInspiredSearchCV
from sklearn.ensemble import RandomForestClassifier
param_grid = {
'n_estimators': range(20, 100, 20),
'max_depth': range(2, 40, 2),
'min_samples_split': range(2, 20, 2),
'max_features': ["auto", "sqrt", "log2"],
}
clf = RandomForestClassifier(random_state=42)
nia_search = NatureInspiredSearchCV(
clf,
param_grid,
algorithm='hba', # hybrid bat algorithm
population_size=50,
max_n_gen=100,
max_stagnating_gen=10,
runs=3,
random_state=None, # or any number if you want same results on each run
)
nia_search.fit(X_train, y_train)
# the best params are stored in nia_search.best_params_
# finally you can train your model with best params from nia search
new_clf = RandomForestClassifier(**nia_search.best_params_, random_state=42)Also you plot the search process with line plot or violin plot.
from sklearn_nature_inspired_algorithms.helpers import score_by_generation_lineplot, score_by_generation_violinplot
# line plot will plot all of the runs, you can specify the metric to be plotted ('min', 'max', 'median', 'mean')
score_by_generation_lineplot(nia_search, metric='max')
# in violin plot you need to specify the run to be plotted
score_by_generation_violinplot(nia_search, run=0)Jupyter notebooks with full examples are available in here.
Using a Custom Nature-Inspired Algorithm
If you do not want to use any of the pre-defined algorithm configurations, you can use any algorithm from the NiaPy collection. This will allow you to have more control of the algorithm behavior. Refer to their documentation and examples for the usage.
Note: Use version >2.x.x of NiaPy package
from niapy.algorithms.basic import GeneticAlgorithm
algorithm = GeneticAlgorithm() # when custom algorithm is provided random_state is ignored
algorithm.set_parameters(NP=50, Ts=5, Mr=0.25)
nia_search = NatureInspiredSearchCV(
clf,
param_grid,
algorithm=algorithm,
population_size=50,
max_n_gen=100,
max_stagnating_gen=20,
runs=3,
)
nia_search.fit(X_train, y_train)Contributing
Detailed information on the contribution guidelines are in the CONTRIBUTING.md.