@Hesamation
Transformers in Excel must be the most cracked thing I've seen. this has everything • Positional Encoding • Self-Attention • Cross-Attention • Multi-head Attention • Skip Connection • LayerNorm • ReLU Activation • Feed Forward • Softmax https://t.co/0JMdf5Yxmx