Update README.md
Browse files
README.md
CHANGED
|
@@ -18,6 +18,11 @@ The choice was fully intentional. I briefly considered a FFT but for this partic
|
|
| 18 |
- Use the templates in [Quant-Cartel/Recommended-Settings](https://huggingface.co/Quant-Cartel/Recommended-Settings) under the `SorcererLM`-folder.
|
| 19 |
- Or Vicuna 1.1 and a sane context template. It's somewhat sensitive to samplers, I'd recommend Temperature 1, MinP 0.05 and a dash of DRY but YMMV. Shorter prompts seem to work better, too.
|
| 20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
## Acknowledgments
|
| 22 |
|
| 23 |
The main shoutout I want to make is to my [Cartel](https://huggingface.co/Quant-Cartel) bros, [Envoid](https://huggingface.co/Envoid) and particularly [I^2](https://huggingface.co/InferenceIllusionist), for being amazing.
|
|
|
|
| 18 |
- Use the templates in [Quant-Cartel/Recommended-Settings](https://huggingface.co/Quant-Cartel/Recommended-Settings) under the `SorcererLM`-folder.
|
| 19 |
- Or Vicuna 1.1 and a sane context template. It's somewhat sensitive to samplers, I'd recommend Temperature 1, MinP 0.05 and a dash of DRY but YMMV. Shorter prompts seem to work better, too.
|
| 20 |
|
| 21 |
+
## Quantized Versions
|
| 22 |
+
|
| 23 |
+
- [iMat GGUFs](https://huggingface.co/Quant-Cartel/SorcererLM-8x22b-iMat-GGUF)
|
| 24 |
+
- [longcal exl2s](https://huggingface.co/Quant-Cartel/SorcererLM-8x22b-bf16-exl2-longcal)
|
| 25 |
+
|
| 26 |
## Acknowledgments
|
| 27 |
|
| 28 |
The main shoutout I want to make is to my [Cartel](https://huggingface.co/Quant-Cartel) bros, [Envoid](https://huggingface.co/Envoid) and particularly [I^2](https://huggingface.co/InferenceIllusionist), for being amazing.
|