Edit model card

Uploaded model

  • Developed by: auchoi
  • License: apache-2.0
  • Finetuned from model : unsloth/Phi-3-mini-4k-instruct-bnb-4bit

This was more of an experiment for me but this was an existing 4bit model that was quantized again to 4bit. it will not perform well

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
10
Safetensors
Model size
2.07B params
Tensor type
F32
BF16
U8
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for auchoi/phi3_4bit_merged

Quantized
(55)
this model