> Thanks the PR ! Excited to see more VTPQ models on the hub. Just a few nits. Thanks also for the nice tests and the documentation
Thank @SunMarc, for your review! We are actively developing ne...
I mean that my colleagues and I can support VPTQ for mllm, but we’re not sure how to integrate it more easily. I hope you can help us identify and avoid some potential pitfalls. We will contribute ...
Hi all,
We are currently working on an extreme low-bit LLM compression project called [VPTQ](https://github.com/microsoft/VPTQ). My colleagues and I are exploring ways to deploy larger LLMs/VLMs...