maxout
nounEtymology Blend of maximum + dropout; coined in a 2013 paper by Ian J. Goodfellow et al.
1
A certain approach to neural networks that attempts to improve on the dropout technique. Its activation function is the maximum of the inputs.
- On the acoustic side, we use a score fusion of three strong models: recurrent nets with maxout activations, very deep convolutional nets with 3x3 kernels, and bidirectional long-short term memory nets which operate on bottleneck features.2016, George Saon, Tom Sercu, Steven Rennie, Hong-Kwang J. Kuo, “The IBM 2016 English Conversational Telephone Speech Recognition System”, in arXiv: