Quantized GGUF model files for mistralai/Mistral-7B-Instruct-v0.3
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit