Reiterate3680 commited on
Commit
2f7f07c
1 Parent(s): 3da7867

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: inflatebot/guns-and-roses-r1
3
+ language:
4
+ - en
5
+ license: other
6
+ pipeline_tag: text-generation
7
+ quantized_by: Reiterate3680
8
+ ---
9
+ L quants (or more), for fun/testing, probably prefer bartowski or mradermacher's quants if available
10
+
11
+ Original Model: https://huggingface.co/inflatebot/guns-and-roses-r1
12
+
13
+ Made with a modified version of https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script
14
+
15
+ Q2_K_L, Q4_K_L, Q5_K_L, Q6_K_L, are using Q_8 output tensors and token embeddings. imatrix is done using bartowski's imatrix dataset