UFLDL Tutorial

From Ufldl

(Difference between revisions)
Jump to: navigation, search
 
(14 intermediate revisions not shown)
Line 33: Line 33:
* [[Softmax Regression]]
* [[Softmax Regression]]
* [[Exercise:Softmax Regression]]
* [[Exercise:Softmax Regression]]
-
 
Line 40: Line 39:
* [[Exercise:Self-Taught Learning]]
* [[Exercise:Self-Taught Learning]]
-
 
-
----
 
-
'''Note''': The sections above this line are stable.  The sections below are still under construction, and may change without notice.  Feel free to browse around however, and feedback/suggestions are welcome.
 
'''Building Deep Networks for Classification'''
'''Building Deep Networks for Classification'''
Line 50: Line 46:
* [[Fine-tuning Stacked AEs]]
* [[Fine-tuning Stacked AEs]]
* [[Exercise: Implement deep networks for digit classification]]
* [[Exercise: Implement deep networks for digit classification]]
 +
 +
 +
'''Linear Decoders with Autoencoders'''
 +
* [[Linear Decoders]]
 +
* [[Exercise:Learning color features with Sparse Autoencoders]]
Line 55: Line 56:
* [[Feature extraction using convolution]]
* [[Feature extraction using convolution]]
* [[Pooling]]
* [[Pooling]]
-
* [[Linear Decoders]]
 
* [[Exercise:Convolution and Pooling]]
* [[Exercise:Convolution and Pooling]]
-
* [[Pooling]]
 
-
* [[Multiple layers of convolution and pooling]]
 
----
----
 +
'''Note''': The sections above this line are stable.  The sections below are still under construction, and may change without notice.  Feel free to browse around however, and feedback/suggestions are welcome.
-
'''Miscellaneous''':
+
'''Miscellaneous'''
 +
* [[MATLAB Modules]]
 +
* [[Style Guide]]
 +
* [[Useful Links]]
-
[[MATLAB Modules]]
+
'''Miscellaneous Topics'''
-
 
+
* [[Data Preprocessing]]
-
[[Data Preprocessing]]
+
* [[Deriving gradients using the backpropagation idea]]
-
 
+
-
[[Style Guide]]
+
'''Advanced Topics''':
'''Advanced Topics''':
-
[[Convolutional training]]  
+
'''Sparse Coding'''
 +
* [[Sparse Coding]]
 +
* [[Sparse Coding: Autoencoder Interpretation]]
 +
* [[Exercise:Sparse Coding]]
-
[[Restricted Boltzmann Machines]]
+
'''ICA Style Models'''
-
 
+
-
[[Deep Belief Networks]]
+
-
 
+
-
[[Denoising Autoencoders]]
+
-
 
+
-
[[Sparse Coding]]
+
-
 
+
-
[[K-means]]
+
-
 
+
-
[[Spatial pyramids / Multiscale]]
+
-
 
+
-
[[Slow Feature Analysis]]
+
-
 
+
-
ICA Style Models:
+
* [[Independent Component Analysis]]
* [[Independent Component Analysis]]
-
* [[Topographic Independent Component Analysis]]
+
* [[Exercise:Independent Component Analysis]]
-
[[Tiled Convolution Networks]]
+
'''Others'''
 +
* [[Convolutional training]]
 +
* [[Restricted Boltzmann Machines]]
 +
* [[Deep Belief Networks]]
 +
* [[Denoising Autoencoders]]
 +
* [[K-means]]
 +
* [[Spatial pyramids / Multiscale]]
 +
* [[Slow Feature Analysis]]
 +
* [[Tiled Convolution Networks]]
----
----
Material contributed by: Andrew Ng, Jiquan Ngiam, Chuan Yu Foo, Yifan Mai, Caroline Suen
Material contributed by: Andrew Ng, Jiquan Ngiam, Chuan Yu Foo, Yifan Mai, Caroline Suen
 +
 +
 +
{{Languages|UFLDL教程|中文}}

Latest revision as of 18:22, 7 April 2013

Description: This tutorial will teach you the main ideas of Unsupervised Feature Learning and Deep Learning. By working through it, you will also get to implement several feature learning/deep learning algorithms, get to see them work for yourself, and learn how to apply/adapt these ideas to new problems.

This tutorial assumes a basic knowledge of machine learning (specifically, familiarity with the ideas of supervised learning, logistic regression, gradient descent). If you are not familiar with these ideas, we suggest you go to this Machine Learning course and complete sections II, III, IV (up to Logistic Regression) first.


Sparse Autoencoder


Vectorized implementation


Preprocessing: PCA and Whitening


Softmax Regression


Self-Taught Learning and Unsupervised Feature Learning


Building Deep Networks for Classification


Linear Decoders with Autoencoders


Working with Large Images


Note: The sections above this line are stable. The sections below are still under construction, and may change without notice. Feel free to browse around however, and feedback/suggestions are welcome.

Miscellaneous

Miscellaneous Topics

Advanced Topics:

Sparse Coding

ICA Style Models

Others


Material contributed by: Andrew Ng, Jiquan Ngiam, Chuan Yu Foo, Yifan Mai, Caroline Suen


Language : 中文

Personal tools