MDDDDR
/

gemma-2b-it-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

MDDDDR commited on Jul 8

Commit

4491063

•

1 Parent(s): 43d0420

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ tokenizer = AutoTokenizer.from_pretrained("MDDDDR/gemma-2b-it-v0.1")
 model = AutoModelForCausalLM.from_pretrained(
     "MDDDDR/gemma-2b-it-v0.1",
     device_map="auto",
-    torch_dtype=torch.bfloat16
 )
 input_text = "사과가 뭐야?"

 model = AutoModelForCausalLM.from_pretrained(
     "MDDDDR/gemma-2b-it-v0.1",
     device_map="auto",
+    torch_dtype=torch.bfloat32
 )
 input_text = "사과가 뭐야?"