Hugging Face's logo

starble-dev
/
Nemo-12B-Marlin-v5-GGUF

Transformers
GGUF
mistral
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
starble-dev commited on
Commit
c44d91d
•
1 Parent(s): 1abacf4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -24,6 +24,8 @@ Currently this is my favorite Mistral-Nemo finetune to be released.
24
 
25
  **Original Model:** [UsernameJustAnother/Nemo-12B-Marlin-v5](https://huggingface.co/UsernameJustAnother/Nemo-12B-Marlin-v5) (Thank you so much for your work ♥)
26
 
 
 
27
  **How to Use:** [llama.cpp](https://github.com/ggerganov/llama.cpp)
28
 
29
  **Original Model License:** Apache 2.0
 
24
 
25
  **Original Model:** [UsernameJustAnother/Nemo-12B-Marlin-v5](https://huggingface.co/UsernameJustAnother/Nemo-12B-Marlin-v5) (Thank you so much for your work ♥)
26
 
27
+ **Official Quants:** [UsernameJustAnother/Nemo-12B-Marlin-v5-gguf ](https://huggingface.co/UsernameJustAnother/Nemo-12B-Marlin-v5-gguf) (Currently only `Q8_0`)
28
+
29
  **How to Use:** [llama.cpp](https://github.com/ggerganov/llama.cpp)
30
 
31
  **Original Model License:** Apache 2.0