Show that the activation function
phi(w) = 1/(1 + exp(-v))
can be approximated by a linear neuron when w(i) are sufficiently small
Probably when w -> 0
exp(-w) -> 1
and 1/(1 + exp(-w)) -> 1/2
Hope this helps
powered by Yahoo Answers
Show that the activation function
phi(w) = 1/(1 + exp(-v))
can be approximated by a linear neuron when w(i) are sufficiently small
Probably when w -> 0
exp(-w) -> 1
and 1/(1 + exp(-w)) -> 1/2
Hope this helps
powered by Yahoo Answers