UnicomLLM
/

Unichat-llama3-Chinese-8B-28K

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

UnicomAI commited on Apr 29

Commit

076a73e

•

1 Parent(s): 7cf2488

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -73,10 +73,10 @@ outputs = pipeline(
         prompt,
         max_new_tokens=2048,
         eos_token_id=terminators,
-        do_sample=False,
         temperature=0.6,
         top_p=1,
-        repetition_penalty=1.1
 )
 print(outputs[0]["generated_text"][len(prompt):])
 ```

         prompt,
         max_new_tokens=2048,
         eos_token_id=terminators,
+        do_sample=True,
         temperature=0.6,
         top_p=1,
+        repetition_penalty=1.15
 )
 print(outputs[0]["generated_text"][len(prompt):])
 ```