Stochastic Gradient Methods with Layer-wise Adaptive Moments for Training of Deep Networks

NovoGrad：使用层级自适应二阶矩进行梯度归一化.

Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentation

一种用于实例分割的复制粘贴数据增强方法.

Large Batch Optimization for Deep Learning: Training BERT in 76 minutes

LAMB：结合层级自适应学习率与Adam.

卷积神经网络的可视化

Visualization methods of Convolutional Neural Networks.

Large Batch Training of Convolutional Networks

LARS：层级自适应学习率缩放.

Lookahead Optimizer: k steps forward, 1 step back

Lookahead：快权重更新k次，慢权重更新1次.