Show that the activation function
phi(w) = 1/(1 + exp(-v))
can be approximated by a linear neuron when w(i) are sufficiently small

Probably when w -> 0
exp(-w) -> 1
and 1/(1 + exp(-w)) -> 1/2
Hope this helps

powered by Yahoo Answers