hugging-quants
/

Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-405B-Instruct-AWQ-INT4 / README.md

Commit History

Improve installation + code snippets

a02b070
verified

Xenova HF staff commited on Jul 23

Improve code snippet (#3)

241b86d
verified

Xenova HF staff commited on Jul 23

Update README.md

a6df051
verified

alvarobartt HF staff commited on Jul 23

Update README.md (#2)

3de5e69
verified

alvarobartt HF staff commited on Jul 23

Create README.md (#1)

61dc0fd
verified

osanseviero HF staff

alvarobartt HF staff commited on Jul 23