Lewdiculous/T.E-8.1-GGUF-IQ-Imatrix-Request

Model name:
T.E-8.1

Brief description:
Qwen2.5-7B based model trained for roleplay uses.

Presets:
You can use the built in ChatML presets within SillyTavern and adjust from there.
Alternatively, check out Virt-io's ChatML v1.9 presets here, make sure you read the repository page for how to use them properly.

Request page:
https://huggingface.co/Lewdiculous/Model-Requests/discussions/76

Model link:
https://huggingface.co/Cran-May/T.E-8.1

Quantized with llama.cpp:
b3837

1. Base⇢ Convert-GGUF(FP16)⇢ Generate-Imatrix-Data(FP16)
2. Base⇢ Convert-GGUF(BF16)⇢ Use-Imatrix-Data(FP16)⇢ Quantize-GGUF(Imatrix-Quants)