Step function

$$\text{step}(z)=\{\begin{array}{ll}0& \text{if }z<0\\ 1& \text{otherwise}\end{array}$$

Not very practical as an activation; since the derivative is discontinuous, we won’t be able to use gradient-descent methods to tune the weights in a network.