Gradient checking and advanced optimization

From Ufldl

Jump to: navigation, search
m
Line 108: Line 108:
to automatically search for a value of <math>\textstyle \theta</math> that minimizes <math>\textstyle J(\theta)</math>.  Algorithms
to automatically search for a value of <math>\textstyle \theta</math> that minimizes <math>\textstyle J(\theta)</math>.  Algorithms
such as L-BFGS and conjugate gradient can often be much faster than gradient descent.
such as L-BFGS and conjugate gradient can often be much faster than gradient descent.
 +
 +
 +
{{Sparse_Autoencoder}}

Revision as of 10:49, 26 May 2011

Personal tools