Autoencoders and Sparsity
From Ufldl
m (minor rephrase) |
|||
Line 1: | Line 1: | ||
So far, we have described the application of neural networks to supervised learning, in which we have labeled | So far, we have described the application of neural networks to supervised learning, in which we have labeled | ||
- | training examples. Now suppose we have only unlabeled training examples | + | training examples. Now suppose we have only a set of unlabeled training examples <math>\textstyle \{x^{(1)}, x^{(2)}, x^{(3)}, \ldots\}</math>, |
where <math>\textstyle x^{(i)} \in \Re^{n}</math>. An | where <math>\textstyle x^{(i)} \in \Re^{n}</math>. An | ||
'''autoencoder''' neural network is an unsupervised learning algorithm that applies backpropagation, | '''autoencoder''' neural network is an unsupervised learning algorithm that applies backpropagation, |