File size: 495 Bytes
54a35b9
 
 
 
 
 
 
 
c8f5690
f778a5d
54a35b9
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
---
base_model: Nitral-AI/Sekhmet_Aleph-L3.1-8B-v0.1
language:
- en
license: other
pipeline_tag: text-generation
quantized_by: Reiterate3680
---
# Not reccomended for use with context sizes above 8192 ([#8676](https://github.com/ggerganov/llama.cpp/pull/8676))

Original Model: https://huggingface.co/Nitral-AI/Sekhmet_Aleph-L3.1-8B-v0.1

made with https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script 

using Q_8 output tensors and token embeddings

using bartowski's imatrix dataset