@_joaogui1 @_clashluke @_arohan_ f(x) = 1.7159*tanh (2/3*x) It satisfies the properties: f(1)=1 f''(x) has a maximum at 1. https://t.co/EuPKszk7Bw
718,710 followers
34 followers
RT @MLDawn2018: @compthink @emna_amor3 See how years ago, @ylecun came up with a very specific type of Sigmoid to avoid vanishing gradient.…
353 followers
RT @MLDawn2018: @compthink @emna_amor3 See how years ago, @ylecun came up with a very specific type of Sigmoid to avoid vanishing gradient.…
1,391 followers
RT @MLDawn2018: @compthink @emna_amor3 See how years ago, @ylecun came up with a very specific type of Sigmoid to avoid vanishing gradient.…