Autoencoders and Sparsity
From Ufldl
m |
|||
Line 26: | Line 26: | ||
then this algorithm will be able to discover some of those correlations. In fact, | then this algorithm will be able to discover some of those correlations. In fact, | ||
this simple autoencoder often ends up learning a low-dimensional representation very similar | this simple autoencoder often ends up learning a low-dimensional representation very similar | ||
- | to | + | to PCAs. |
Our argument above relied on the number of hidden units <math>\textstyle s_2</math> being small. But | Our argument above relied on the number of hidden units <math>\textstyle s_2</math> being small. But |