Self-Taught Learning to Deep Networks
From Ufldl
(→From Self-Taught Learning to Deep Networks) |
(→From Self-Taught Learning to Deep Networks) |
||
Line 15: | Line 15: | ||
classifier to map from the features <math>\textstyle a^{(i)}</math> to the classification label <math>\textstyle y</math>. | classifier to map from the features <math>\textstyle a^{(i)}</math> to the classification label <math>\textstyle y</math>. | ||
- | As before, we can draw our logistic unit (show in | + | As before, we can draw our logistic unit (show in orange) as |
follows: | follows: | ||
- | [[File: | + | [[File:STL_Logistic_Classifier.png]] |
If we now look at the final classifier that we've learned, in terms | If we now look at the final classifier that we've learned, in terms | ||
Line 25: | Line 25: | ||
particular, the final classifier looks like this: | particular, the final classifier looks like this: | ||
- | [[File: | + | [[File:STL_CombinedAE.png]] |
This model was trained in two stages. The first layer of weights <math>\textstyle W^{(1)}</math> | This model was trained in two stages. The first layer of weights <math>\textstyle W^{(1)}</math> |