Update README.md

README.md

@@ -31,6 +31,66 @@ tags:
    
 - **Environment** : Colab 환경에서 진행하였으며 L4 GPU를 사용하였습니다. 
 
+<details>
+  <summary>How to use</summary>
+  
+  **Model Load**
+  
+  ``` python
+  
+  #!pip install transformers==4.40.0 accelerate
+  import os
+  import torch
+  from transformers import AutoTokenizer, AutoModelForCausalLM
+  
+  model_id = 'Dongwookss/small_fut_final'
+  
+  tokenizer = AutoTokenizer.from_pretrained(model_id)
+  model = AutoModelForCausalLM.from_pretrained(
+      model_id,
+      torch_dtype=torch.bfloat16,
+      device_map="auto",
+  )
+  model.eval()
+  ```
+
+  **Query**
+
+  ```python
+  from transformers import TextStreamer
+  PROMPT = '''Below is an instruction that describes a task. Write a response that appropriately completes the reques문"
+  
+  messages = [
+      {"role": "system", "content": f"{PROMPT}"},
+      {"role": "user", "content": f"{instruction}"}
+      ]
+  
+  input_ids = tokenizer.apply_chat_template(
+      messages,
+      add_generation_prompt=True,
+      return_tensors="pt"
+  ).to(model.device)
+  
+  terminators = [
+      tokenizer.eos_token_id,
+      tokenizer.convert_tokens_to_ids("<|eot_id|>")
+  ]
+  
+  text_streamer = TextStreamer(tokenizer)
+  _ = model.generate(
+      input_ids,
+      max_new_tokens=4096,
+      eos_token_id=terminators,
+      do_sample=True,
+      streamer = text_streamer,
+      temperature=0.6,
+      top_p=0.9,
+      repetition_penalty = 1.1
+  )
+  
+  ```
+
+</details>
 
 <details>
   <summary>Fine-Tuning with Unsloth(SFT Trainer)</summary>