Self-Taught Learning to Deep Networks
From Ufldl
(→Discussion) |
|||
Line 5: | Line 5: | ||
hidden layer to extract features <math>\textstyle a</math>. This is shown as follows: | hidden layer to extract features <math>\textstyle a</math>. This is shown as follows: | ||
- | [[File:STL_SparseAE_Features.png]] | + | [[File:STL_SparseAE_Features.png|300px]] |
Now, we are interested in solving a classification task, where our goal is to | Now, we are interested in solving a classification task, where our goal is to | ||
Line 18: | Line 18: | ||
follows: | follows: | ||
- | [[File:STL_Logistic_Classifier.png]] | + | [[File:STL_Logistic_Classifier.png|300px]] |
If we now look at the final classifier that we've learned, in terms | If we now look at the final classifier that we've learned, in terms | ||
Line 25: | Line 25: | ||
particular, the final classifier looks like this: | particular, the final classifier looks like this: | ||
- | [[File:STL_CombinedAE.png]] | + | [[File:STL_CombinedAE.png|300px]] |
This model was trained in two stages. The first layer of weights <math>\textstyle W^{(1)}</math> | This model was trained in two stages. The first layer of weights <math>\textstyle W^{(1)}</math> |