@arankomatsuzaki
@airkatakana That's pretty early! I wasn't even doing ML yet in 2012. I don't know powerful demo of RNN/LSTM LM back in 2012 and before, but the first one I was impressed was Karpathy's char-rnn back in 2014-15. But the first one that started generating coherent sentences was probaby the 2016 paper I cited above, which gave me conviction with LLM as a path toward AGI.