Commit
•
b519fad
1
Parent(s):
eec31bb
"Update README.md"
Browse files
README.md
CHANGED
|
@@ -43,7 +43,7 @@ The core project making use of the ggml library is the [llama.cpp](https://githu
|
|
| 43 |
|
| 44 |
There is a bunch of quantized files available. How to choose the best for you:
|
| 45 |
|
| 46 |
-
#
|
| 47 |
|
| 48 |
Q4_0, Q4_1, Q5_0, Q5_1 and Q8 are `legacy` quantization types.
|
| 49 |
Nevertheless, they are fully supported, as there are several circumstances that cause certain model not to be compatible with the modern K-quants.
|
|
@@ -57,6 +57,7 @@ With a Q6_K you should find it really hard to find a quality difference to the o
|
|
| 57 |
|
| 58 |
|
| 59 |
|
|
|
|
| 60 |
# Original Model Card:
|
| 61 |
This is WizardLM trained on top of tiiuae/falcon-40b, with a subset of the dataset - responses that contained alignment / moralizing were removed. The intent is to train a WizardLM that doesn't have alignment built-in, so that alignment (of any sort) can be added separately with for example with a RLHF LoRA.
|
| 62 |
|
|
@@ -76,6 +77,7 @@ What is a falcon? Can I keep one as a pet?
|
|
| 76 |
Thank you [chirper.ai](https://chirper.ai) for sponsoring some of my compute!
|
| 77 |
|
| 78 |
***End of original Model File***
|
|
|
|
| 79 |
|
| 80 |
|
| 81 |
## Please consider to support my work
|
|
|
|
| 43 |
|
| 44 |
There is a bunch of quantized files available. How to choose the best for you:
|
| 45 |
|
| 46 |
+
# Legacy quants
|
| 47 |
|
| 48 |
Q4_0, Q4_1, Q5_0, Q5_1 and Q8 are `legacy` quantization types.
|
| 49 |
Nevertheless, they are fully supported, as there are several circumstances that cause certain model not to be compatible with the modern K-quants.
|
|
|
|
| 57 |
|
| 58 |
|
| 59 |
|
| 60 |
+
---
|
| 61 |
# Original Model Card:
|
| 62 |
This is WizardLM trained on top of tiiuae/falcon-40b, with a subset of the dataset - responses that contained alignment / moralizing were removed. The intent is to train a WizardLM that doesn't have alignment built-in, so that alignment (of any sort) can be added separately with for example with a RLHF LoRA.
|
| 63 |
|
|
|
|
| 77 |
Thank you [chirper.ai](https://chirper.ai) for sponsoring some of my compute!
|
| 78 |
|
| 79 |
***End of original Model File***
|
| 80 |
+
---
|
| 81 |
|
| 82 |
|
| 83 |
## Please consider to support my work
|