Request: intervitens/mini-magnum-12b-v1.1
Model name:
Mini Magnum 12b v1.1
Model link:
https://huggingface.co/intervitens/mini-magnum-12b-v1.1
Brief description:
This model is the miniature version of alpindale/magnum-72b-v1, a second entry in a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet and Opus. This model is fine-tuned on top of Mistral-Nemo-Base-2407.
An image/direct image link to represent the model (square shaped):
Hi @Lewdiculous , I know you only do models up to 11b parameters, but I would really appreciate if you could do this model which is slightly larger (12b).
These are pretty large. I'll try to get this one done as soon as possible.
I have adjusted the image. Old image inside comment.
134GB artifacts being uploaded at:
https://huggingface.co/Lewdiculous/mini-magnum-12b-v1.1-GGUF-IQ-Imatrix
I'm not sure which Quant options for this size people prefer.