danluu / Ufldl Tutorial

These are solutions to the exercises up at the Stanford OpenClassroom Deep Learning class and Andrew Ng's UFLDL Tutorial. When I was solving these, I looked around for copies of the solutions so I could compare notes because debugging learning algorithms is often tedious in a way that isn't educational, but almost everything I found was incomplete or obviously wrong. I don't promise that these don't have bugs, but they at least give outputs within the range of the expected outputs for the assignments.

I've attempted to make this Octave compatible, so that you can run this with free software. It seems to work, but the results are slightly different. One side effect of this is that I'm using fminlbfgs instead of minFunc. It ran for me with Octave 3.6.4; my understanding is that Octave 3.8 and newer versions aren't completely backwards compatible, so you may run into problems with the current version of octave. Pull requests welcome, of course.

Here's the order of the exercises:

Stanford OpenClassroom Deep Learning class

1. linear.m
2. multiple.m
3. logistic.m

Unsupervised Feature Learning and Deep Learning Tutorial

1. Sparse Autoencoder: sparseae_exercise/train.m

2. Vectorized Implementation: sparseae_exercise/train.m (1 is already vectorized)

3.1. PCA in 2d: pca_2d/pca_2d.m

3.2. PCA: pca_gen/pca_gen.m

4. Softmax Regression: softmax_exercise/softmaxExercise.m

5. Self-Taught Learning: stl_exercise/stlExercise.m

6. Building Deep Networks for Classification: stackedae_exercise/stackedAEExercise.m

7. Learning Color Features with Sparse Autoencoders: linear_decoder_exercise/linearDecoderExercise.m

8. Convolution and Pooling: cnn_exercise/cnnExercise.m