DingKe / Pytorch_workplace

Learn pytorch with examples.

basic

Toy example shows how to write customized Function and Module.

rnn

Implementation RNN (Vanilla, GRU, LSTM, LSTMP) from scratch. Gradient is clipped to avoid explosion, using pytorch Variable's register_hook function.

binary

BinaryNet with pytorch. Manipulate learning by 1) modifying optimizer (mlp.py) or 2) using param_groups (cnn.py).

cffi

Extend pytorch with cffi.

meprop

meprop training

focalloss

Focal Loss

senet

Squeeze and Excitation Networks

swish

Sigmoid-weighted Linear Units (i.e. Swish activation)

amsgrad

Modified (corrected) Adam optimizer.

nvrtc

CUDA extension by compiling CUDA kernels online.

dgc

Deep Gradient Compression.