rAIfle
/

experiment_1_8b-fp16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

rAIfle commited on Apr 29

Commit

ad8f346

•

1 Parent(s): 6cbc9ad

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ model = FastLanguageModel.get_peft_model(
     # [NEW] "unsloth" uses 30% less VRAM, fits 2x larger batch sizes!
     use_gradient_checkpointing = "unsloth", # True or "unsloth" for very long context
     random_state = 3407,
-    use_rslora = True,  # We support rank stabilized LoRA
     loftq_config = None, # And LoftQ
 )

     # [NEW] "unsloth" uses 30% less VRAM, fits 2x larger batch sizes!
     use_gradient_checkpointing = "unsloth", # True or "unsloth" for very long context
     random_state = 3407,
+    use_rslora = False,  # We support rank stabilized LoRA
     loftq_config = None, # And LoftQ
 )