@roy_eisenstadt
1/7 ๐ฅฅ New speculative decoding method! Introducing DCOCO: Contextual Correction of Parallel Drafts. Parallel drafters are fast, but lose context between predicted tokens. DCOCO restores it without giving up parallelism. Up to 6.6ร faster than vanilla decoding. ๐งต https://t.co/gdgRcytlxD