leaky rectified linear unit
nounEtymology Named after the rectified linear unit, where “leaky” denotes how the negative half of the function becomes slightly negative, being “leaky” in comparison to the default ReLU, which is zero.
1
A variation of the rectified linear unit, defined as f(x)=x when x≥0 and f(x)=αx for some small α, e.g. 0.01, when x<0.
Artificial intelligence; neural computing; artificial intelligence; neural computing
- Derived terms
- LReLU