wiseodd / Hipsternet
Licence: unlicense
All the hipster things in Neural Net in a single repo
Stars: ✭ 250
Programming Languages
python
139335 projects - #7 most used programming language
hipsternet
All the hipster things in Neural Net in a single repo: hipster optimization algorithms, hispter regularizations, everything!
Note, things will be added over time, so not all the hipsterest things will be here immediately. Also don't use this for your production code: use this to study and learn new things in the realm of Neural Net, Deep Net, Deep Learning, whatever.
What's in it?
Network Architectures
- Convolutional Net
- Feed Forward Net
- Recurrent Net
- LSTM Net
- GRU Net
Optimization algorithms
- SGD
- Momentum SGD
- Nesterov Momentum
- Adagrad
- RMSprop
- Adam
Loss functions
- Cross Entropy
- Hinge Loss
- Squared Loss
- L1 Regression
- L2 Regression
Regularization
- Dropout
- Your usual L1 and L2 regularization
Nonlinearities
- ReLU
- leaky ReLU
- sigmoid
- tanh
Hipster techniques
- BatchNorm
- Xavier weight initialization
Pooling
- Max pooling
- Average pooling
How to run this?
- Install miniconda http://conda.pydata.org/miniconda.html
- Do
conda env create
- Enter the env
source activate hipsternet
- [Optional] To install Tensorflow:
chmod +x tensorflow.sh; ./tensorflow.sh
- Do things with the code if you want to
- To run the example:
-
python run_mnist.py {ff|cnn}
;cnn
for convnet model,ff
for the feed forward model -
python run_rnn.py {rnn|lstm|gru}
;rnn
for vanilla RNN model,lstm
for LSTM net model,gru
for GRU net model - Just close the terminal if you done (or
source deactivate
, not a fan though)
What can I do with this?
Do anything you want. I licensed this with Unlicense License http://unlicense.org, as I need to take a break of using WTFPL license.
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].