@gerardsans
@NicolasZucchet @heyyalexwang Transformers work completely different from NN. Memorisation is also a very unfortunate term. Conditioned token sampling that matches a sampled sequence up to a certain threshold seems a better phrasing. Can’t really make any sense of your terminology. There’s no memory anywhere.