The rectified linear unit (ReLU) activation function is a non-linear function that is commonly used in artificial neural networks. It is defined as follows:
f(x) = max(0, x)
In other words, the ReLU function outputs the input value if it is positive, and 0 if it is negative. This makes it a non-linear function, which is important for neural networks to learn complex patterns.

свернуть