File size: 739 Bytes
c4f4b9a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
bd1ea50
 
c4f4b9a
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
---
license: cc-by-nc-4.0
base_model:
- BlueNipples/SnowLotus-v2-10.7B
- Himitsui/KuroMitsu-11B
tags:
- mergekit
- merge
---

This is an EXL2 quantized model of [saishf/Kuro-Lotus-10.7B](https://huggingface.co/saishf/Kuro-Lotus-10.7B) using the default calibration dataset.
The quants are uploaded on individual branches and the list is here:
[4bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/4bpw)
[3.75bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3.75bpw)
[3.5bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3.5bpw)
[3.25bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3.25bpw)
[3bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3bpw)

Prompt format is Alpaca.