llm-jp
/

llm-jp-13b-v2.0

Text Generation

text-generation-inference

Model card Files Files and versions Community

hkiyomaru commited on Apr 26

Commit

820cd7d

•

1 Parent(s): 35675cd

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -49,7 +49,7 @@ Checkpoints format: Hugging Face Transformers
 - accelerate>=0.27.2
 - flash-attn>=2.5.6
-## Usage (To be updated)
 ```python
 import torch
@@ -65,6 +65,7 @@ with torch.no_grad():
         do_sample=True,
         top_p=0.95,
         temperature=0.7,
     )[0]
 print(tokenizer.decode(output))
 ```

 - accelerate>=0.27.2
 - flash-attn>=2.5.6
+## Usage
 ```python
 import torch
         do_sample=True,
         top_p=0.95,
         temperature=0.7,
+        repetition_penalty=1.05,
     )[0]
 print(tokenizer.decode(output))
 ```