@mervenoyann
friendly reminder: this is on Monday π€ β learn about speculative decoding to speed-up inference β if you're a beginner and not interested, just use https://t.co/eZJZOpPFkl that does this for you automatically π¦ https://t.co/97svGez4R3