Lewdiculous's picture
Update README.md
77558ed verified
|
raw
history blame
1.97 kB
metadata
language:
  - en
pipeline_tag: text-generation
tags:
  - text-generation-inference
  - instruct
  - conversational
  - roleplay
license: cc-by-4.0

Description

This repo contains GGUF-IQ-Imatrix format model files for Erosumika-7B-v3-0.2.

Quants to be uploaded:

     "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",
     "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"

Erosumika-7B-v3-0.2

~Mistral 0.2 Edition~

Header GIF

Model Details

The Mistral 0.2 version of Erosumika-7B-v3, a DARE TIES merge between Nitral's Kunocchini-7b, Endevor's InfinityRP-v1-7B and my FlatErosAlpha, a flattened(in order to keep the vocab size 32000) version of tavtav's eros-7B-ALPHA. Alpaca and ChatML work best. Slightly smarter and better prompt comprehension than Mistral 0.1 Erosumika-7B-v3. 32k context should work.

GGUF quants

Limitations and biases

The intended use-case for this model is fictional writing for entertainment purposes. Any other sort of usage is out of scope. It may produce socially unacceptable or undesirable text, even if the prompt itself does not include anything explicitly offensive. Outputs might often be factually wrong or misleading.

merge_method: task_arithmetic
base_model: alpindale/Mistral-7B-v0.2-hf
models:
  - model: localfultonextractor/Erosumika-7B-v3
    parameters:
      weight: 1.0
dtype: float16