Hugging Face's logo

neuralmagic
/
Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation
Transformers
Safetensors
llama
int8
vllm
conversational
text-generation-inference
Inference Endpoints
8-bit precision
Model card Files Community
1
Meta-Llama-3.1-8B-Instruct-quantized.w8a8 / recipe.yaml

Commit History

Upload folder using huggingface_hub
25b9a14
verified

alexmarques commited on