# Neural Networks

### From Ufldl

Line 52: | Line 52: | ||

A neural network is put together by hooking together many of our simple | A neural network is put together by hooking together many of our simple | ||

- | + | "neurons," so that the output of a neuron can be the input of another. For | |

example, here is a small neural network: | example, here is a small neural network: | ||

Line 58: | Line 58: | ||

In this figure, we have used circles to also denote the inputs to the network. The circles | In this figure, we have used circles to also denote the inputs to the network. The circles | ||

- | labeled | + | labeled "+1" are called '''bias units''', and correspond to the intercept term. |

The leftmost layer of the network is called the '''input layer''', and the | The leftmost layer of the network is called the '''input layer''', and the | ||

rightmost layer the '''output layer''' (which, in this example, has only one | rightmost layer the '''output layer''' (which, in this example, has only one |