# Gradient checking and advanced optimization

### From Ufldl

m |
|||

Line 108: | Line 108: | ||

to automatically search for a value of <math>\textstyle \theta</math> that minimizes <math>\textstyle J(\theta)</math>. Algorithms | to automatically search for a value of <math>\textstyle \theta</math> that minimizes <math>\textstyle J(\theta)</math>. Algorithms | ||

such as L-BFGS and conjugate gradient can often be much faster than gradient descent. | such as L-BFGS and conjugate gradient can often be much faster than gradient descent. | ||

+ | |||

+ | |||

+ | {{Sparse_Autoencoder}} |