activation function

some of the most common activation functions are the following:

• the sigmoid function
• the relu function
• the softplus function
• the tanh function
• the softmax function

the five of these functions are monotonically nondecreasing