aixsatoshi
/

Honyaku-7b-v2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

aixsatoshi commited on Apr 8

Commit

311cc5a

•

1 Parent(s): 5265492

Update README.md

Files changed (1) hide show

README.md +3 -0

README.md CHANGED Viewed

@@ -194,6 +194,9 @@ def predict(message, tokens, temperature, language):
         **model_inputs,
         max_new_tokens=int(tokens),
         temperature=float(temperature),
         num_beams=1,
         eos_token_id=tokenizer.eos_token_id
     )

         **model_inputs,
         max_new_tokens=int(tokens),
         temperature=float(temperature),
+        do_sample=True,
+        top_p=0.95,
+        top_k=20,
         num_beams=1,
         eos_token_id=tokenizer.eos_token_id
     )