Update README.md

README.md

@@ -7,9 +7,9 @@ base_model: alpindale/WizardLM-2-8x22B
 
 Oh boy, here we go. Low-rank (`r=16, alpha=32`) LoRA on top of [WizardLM-2-8x22B](https://huggingface.co/alpindale/WizardLM-2-8x22B), trained on 2 epochs of (cleaned & deduped) c2-logs. As far as I can tell, this is an upgrade from `WizardLM-2-8x22B` for RP purposes.
 
-## Why LoRA?
+## Why A LoRA?
 
-Fully intentional. `WizardLM-2-8x22B` is smart by itself but its used vocabulary leaves much to be desired when it comes to RP. By training a low-rank LoRA on top of it to teach it some of Claude's writing style, we remedy that.
+The choice was fully intentional. I briefly considered a FFT but for this particular use-case a LoRA seemed a better fit, both functionally and for my wallet. `WizardLM-2-8x22B` is smart by itself but its used vocabulary leaves much to be desired when it comes to RP. By training a low-rank LoRA on top of it to teach it some of Claude's writing style, we remedy that.
 
 ## Prompting