Whitening
From Ufldl
(→Introduction) |
|||
| Line 5: | Line 5: | ||
which is needed for some algorithms. If we are training on images, | which is needed for some algorithms. If we are training on images, | ||
the raw input is redundant, since adjacent pixel values | the raw input is redundant, since adjacent pixel values | ||
| - | are highly correlated. The goal of whitening is to make the input less redundant, | + | are highly correlated. The goal of whitening is to make the input less redundant; more formally, |
| - | + | our desiderata are that our learning algorithms sees a training input where (i) the features are less | |
correlated with each other, and (ii) the features all have the same variance. | correlated with each other, and (ii) the features all have the same variance. | ||
