tiinav/qwen_merge2

qwen_merge_2

This model is the result of merge of the following models made with flow-merge:

• Base model:
  • Qwen/Qwen1.5-0.5B
• Models:
  • Qwen/Qwen1.5-0.5B-chat
  • minghaowu/Qwen1.5-0.5B-OpenHermes-2.5

flow-merge config

The following configuration was used to merge the models:

base_model: Qwen/Qwen1.5-0.5B
models:
- path_or_id: Qwen/Qwen1.5-0.5B
- path_or_id: Qwen/Qwen1.5-0.5B-chat
- path_or_id: minghaowu/Qwen1.5-0.5B-OpenHermes-2.5
method: addition-task-arithmetic
device: !!python/object/apply:flow_merge.lib.constants.DeviceIdentifier
- cpu
method_global_parameters:
  scaling_coefficient: 0.7
  normalize: false
directory_settings:
  cache_dir: null
  local_dir: ./models
  output_dir: ./merged_model