Neural Networks
From Ufldl
(Created page with "Consider a supervised learning problem where we have access to labeled training examples <math>(x^{(i)}, y^{(i)})</math>. Neural networks give a way of defining a complex, non-l...") |
|||
| Line 8: | Line 8: | ||
diagram to denote a single neuron: | diagram to denote a single neuron: | ||
| - | + | [[Image:SingleNeuron.png|400px|center]] | |
| - | This | + | This "neuron" is a computational unit that takes as input <math>x_1, x_2, x_3</math> (and a +1 intercept term), and |
outputs <math>h_{W,b}(x) = f(W^Tx) = f(\sum_{i=1}^3 W_{i}x_i +b)</math>, where <math>f : \Re \mapsto \Re</math> is | outputs <math>h_{W,b}(x) = f(W^Tx) = f(\sum_{i=1}^3 W_{i}x_i +b)</math>, where <math>f : \Re \mapsto \Re</math> is | ||
called the '''activation function'''. In these notes, we will choose | called the '''activation function'''. In these notes, we will choose | ||
