Cobra is a Python package to build predictive models using linear or logistic regression with a focus on performance and interpretation. It consists of several modules for data preprocessing, feature selection and model evaluation. The underlying methodology was developed at Python Predictions in the course of hundreds of business-related prediction challenges. It has been tweaked, tested and optimized over the years based on feedback from clients, our team, and academic researchers.
Main features
Prepare a given pandas DataFrame for predictive modelling:
- partition into train/selection/validation sets
- create bins from continuous variables
- regroup categorical variables based on statistical significance
- replace missing values
- add columns where categories/bins are replaced with average of target values (linear regression) or with incidence rate (logistic regression)
Perform univariate feature selection based on RMSE (linear regression) or AUC (logistic regression)
Compute correlation matrix of predictors
Find the suitable variables using forward feature selection
Evaluate model performance and visualize the results
Getting started
These instructions will get you a copy of the project up and running on your local machine for usage, development and testing purposes.
Requirements
This package requires only the usual Python libraries for data science, being numpy, pandas, scipy, scikit-learn, matplotlib, seaborn, and tqdm. These packages, along with their versions are listed in requirements.txt and can be installed using pip:
pip install -r requirements.txt
Note: if you want to install Cobra with e.g. pip, you don't have to install all of these requirements as these are automatically installed with Cobra itself.
Installation
The easiest way to install Cobra is using pip:
pip install -U pythonpredictions-cobra
Documentation and extra material
- A blog post on the overall methodology.
- A research article by Geert Verstraeten (co-founder Python Predictions) discussing the preprocessing approach we use in Cobra.
- HTML documentation of the individual modules.
- A step-by-step tutorial for logistic regression.
- A step-by-step tutorial for linear regression.
- Check out the Data Science Leuven Meetup talk by one of the core developers (second presentation). His slides and related material are also available.
Contributing to Cobra
We'd love you to contribute to the development of Cobra! There are many ways in which you can contribute, the most common of which is to contribute to the source code or documentation of the project. However, there are many other ways you can contribute (report issues, improve code coverage by adding unit tests, ...). We use GitHub issues to track all bugs and feature requests. Feel free to open an issue in case you found a bug or in case you wish to see a new feature added.
For more details, check out our wiki.