Autoencoders and Sparsity

From Ufldl

Jump to: navigation, search
m
Line 26: Line 26:
then this algorithm will be able to discover some of those correlations. In fact,
then this algorithm will be able to discover some of those correlations. In fact,
this simple autoencoder often ends up learning a low-dimensional representation very similar
this simple autoencoder often ends up learning a low-dimensional representation very similar
-
to PCA's.
+
to PCAs.
Our argument above relied on the number of hidden units <math>\textstyle s_2</math> being small.  But
Our argument above relied on the number of hidden units <math>\textstyle s_2</math> being small.  But

Revision as of 21:15, 23 April 2011

Personal tools