Provide SpQR trained model weights on OpenLLaMA?

[jayxsinha]

Hi

I was wondering if you folks can provide SpQR trained model weights on OpenLLaMA?

OpenLLaMA has Apache-2.0 and has reported closer to the original LLaMA’s performance on benchmarks.

Thanks. (And awesome research btw 😊)

[Vahe1994]

Hello!
Thank you for your interest in the paper and your kind words.
I think it is good idea. Once we publish the inference code, I will get back to this issue.