All Projects → llSourcell → Make_a_neural_network

llSourcell / Make_a_neural_network

This is the code for the "Make a Neural Network" - Intro to Deep Learning #2 by Siraj Raval on Youtube

Programming Languages

python
139335 projects - #7 most used programming language

Make_a_neural_network

This is the code for the "Make a Neural Network" - Intro to Deep Learning #2 by Siraj Raval on Youtube

##Overview

This is the code for this video by Siraj Raval on Youtube. This is a simple single layer feedforward neural network (perceptron). We use binary digits as our inputs and expect binary digits as our outputs. We'll use backpropagation via gradient descent to train our network and make our prediction as accurate as possible.

##Dependencies

None! Just numpy.

##Usage

Run python demo.py in terminal to see it train, then predict.

##Challenge

The challenge for this video is to create a 3 layer feedforward neural network using only numpy as your dependency. By doing this, you'll understand exactly how backpropagation works and develop an intuitive understanding of neural networks, which will be useful for more the more complex nets we build in the future. Backpropagation usually involves recursively taking derivatives, but in our 1 layer demo there was no recursion so was a trivial case of backpropagation. In this challenge, there will be. Use a small binary dataset, you can define one programmatically like in this example.

Bonus -- use a larger, more interesting dataset

##Credits

The credits for this code go to Milo Harper. I've merely created a wrapper to get people started.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].