Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)

ELU：消除偏差偏置的指数线性单元.

Bridging Nonlinearities and Stochastic Regularizers with Gaussian Error Linear Units

GELU：随机正则化的高斯误差线性单元.

使用scipy.optimize.minimize求解非线性规划

scipy.optimize.minimize.

Continuously Differentiable Exponential Linear Units

CELU：连续可微的指数线性单元.

Mish: A Self Regularized Non-Monotonic Activation Function

Mish：一种自正则化的非单调激活函数.

泰勒公式(Taylor Formula)

Taylor Formula.