Holocron

Implementations of recent Deep Learning tricks in Computer Vision, easily paired up with your favorite framework and model zoo.

Holocrons were information-storage datacron devices used by both the Jedi Order and the Sith that contained ancient lessons or valuable information in holographic form.

Source: Wookieepedia

Table of Contents

• Getting Started
  • Prerequisites
  • Installation
• Usage
• Technical Roadmap
• Documentation
• Contributing
• License

Note: support of activation mapper and model summary has been dropped and outsourced to independent packages (torch-cam & torch-scan) to clarify project scope.

Getting started

Prerequisites

• Python 3.6 (or more recent)
• pip

Installation

You can install the package using pypi as follows:

pip install pylocron

or using conda:

conda install -c frgfm pylocron

Usage

nn

Main features

• Activation: SiLU/Swish, Mish, HardMish, NLReLU, FReLU
• Loss: Focal Loss, MultiLabelCrossEntropy, LabelSmoothingCrossEntropy, MixupLoss, ClassBalancedWrapper, ComplementCrossEntropy, MutualChannelLoss
• Convolutions: NormConv2d, Add2d, SlimConv2d, PyConv2d
• Regularization: DropBlock
• Pooling: BlurPool2d, SPP, ZPool
• Attention: SAM, LambdaLayer, TripletAttention

models

Main features

• Classification: Res2Net (based on the great implementation from Ross Wightman), Darknet-24, Darknet-19, Darknet-53, CSPDarknet-53, ResNet, ResNeXt, TridentNet, PyConvResNet, ReXNet, SKNet, RepVGG.
• Detection: YOLOv1, YOLOv2, YOLOv4
• Segmentation: U-Net, UNet++, UNet3+

ops

Main features

• boxes: Distance-IoU & Complete-IoU losses

optim

Main features

• Optimizer: LARS, Lamb, RAdam, TAdam, AdamP, AdaBelief, and customized versions (RaLars)
• Optimizer wrapper: Lookahead, Scout (experimental)
• Scheduler: OneCycleScheduler (this implementation was made before PyTorch officially had an implementation, for better support it is advised to consider the official PyTorch version)

Technical roadmap

The project is currently under development, here are the objectives for the next releases:

• [x] Standardize models: standardize models by task.
• [x] Reference scripts: add reference training scripts
• [ ] Speed benchmark: compare holocron.nn functions execution speed.

Documentation

The full package documentation is available here for detailed specifications. The documentation was built with Sphinx using a theme provided by Read the Docs

Contributing

Please refer to CONTRIBUTING if you wish to contribute to this project.

License

Distributed under the MIT License. See LICENSE for more information.