SmoothQuant: Weight-Only vs W8A8
Large Language Models(LLMs) are the pinnacle of technology in computer science, the architecture behind these models is capable of translating, conversing and writing code on a level comparable to humans in some cases. But as with all things, there is a catch, they require massive amounts of compute power