TheBloke
/

Llama-2-70B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

Fine-tuning?

#14 opened 12 months ago by

OSK-Creative-Tech

The model is not responding.

#13 opened about 1 year ago by

model responses not good.

#12 opened about 1 year ago by

how to quant llama2 70b model with AutoGPTQ

#11 opened about 1 year ago by

Wrong shape when loading with Peft-AutoGPTQ

#10 opened about 1 year ago by

Long waiting time

#9 opened about 1 year ago by

Context Length Differences

#7 opened about 1 year ago by

Problems with temperature when using with python code.

#6 opened about 1 year ago by

Should we expect GGML soon?

#5 opened about 1 year ago by

Issue with 64g version?

#4 opened about 1 year ago by

The `main` branch for TheBloke/Llama-2-70B-GPTQ appears borked

#3 opened about 1 year ago by

I found an fp16 model if it helps

#2 opened about 1 year ago by

❤️❤️❤️❤️

#1 opened about 1 year ago by