metadata

base_model:
  - Pyroserenus/Orthrus-12b-v0.8
  - nbeerbower/mistral-nemo-gutenberg-12B-v2
  - mergekit-community/Deutscher-Pantheon-12B
  - IntervitensInc/Mistral-Nemo-Base-2407-chatml
library_name: transformers
tags:
  - mergekit
  - merge
license: cc-by-nc-4.0

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using IntervitensInc/Mistral-Nemo-Base-2407-chatml as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: mergekit-community/Deutscher-Pantheon-12B
    parameters:
      weight: 0.3
      density: 0.5
  - model: nbeerbower/mistral-nemo-gutenberg-12B-v2
    parameters:
      weight: 0.3
      density: 0.5
  - model: Pyroserenus/Orthrus-12b-v0.8
    parameters:
      weight: 0.6
      density: 0.5
merge_method: dare_ties
base_model: IntervitensInc/Mistral-Nemo-Base-2407-chatml
dtype: bfloat16
name: Ultra-Instruct-12B

Not responsible for what you do with it. Use with caution. WARNING: UNCENSORED. SMART.

Use ChatML. Note: It appears it has trouble stopping. If you value extremly long replies, this might be the model for you.