DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome

DNABERT：基因组DNA序列的预训练双向编码表示.

Revisiting Convolution Architecture in the Realm of DNA Foundation Models

重新回顾DNA基础模型中的卷积结构.

The Mathematical Relationship Between Layer Normalization and Dynamic Activation Functions

层归一化和动态激活函数之间的数学关系.

博物记：梅杏桃樱李梨海棠

Distinguish Flowers of Plum, Apricot, Peach, Cherry, Plum, Pear, and Crabapple.

Transformers without Normalization

无归一化的Transformer.

Systems and Algorithms for Convolutional Multi-Hybrid Language Models at Scale

大规模卷积多混合语言模型的系统与算法.