@mervenoyann
AutoGPTQ is now natively supported in transformers! π€© AutoGPTQ is a library for GPTQ, a post-training quantization technique to quantize autoregressive generative LLMs. π¦ With this integration, you can quantize LLMs with few lines of code! Read more π https://t.co/QPW3DJ0erm https://t.co/9OFACotev7