Llama 3.1 70B high-quality HQQ quantized model - 99%+ quality of fp16

I'm not really sure if that's possible but adding that to ollama could really impact the performance on 4-bit quant option: 99%+ in all benchmarks in lm-eval relative performance to FP16 and similar inference speed to fp16 url: https://huggingface.co/mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq <img width="604" alt="Screenshot 2024-08-13 at 19 03 57" src="https://github.com/user-attachments/assets/64cd0427-b7c7-4fb8-b846-15f172669248"> also this: https://huggingface.co/ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit <img width="597" alt="Screenshot 2024-08-13 at 19 07 18" src="https://github.com/user-attachments/assets/c3518ffe-323d-42f0-9162-d188179797fb">