tabtoyou commited on
Commit
c42a813
β€’
1 Parent(s): 2769331

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -2,7 +2,7 @@
2
  license: apache-2.0
3
  ---
4
  ### Korean Otter
5
- [Otter](https://huggingface.co/luodian/OTTER-9B-LA-InContext) λͺ¨λΈμ„ [KoLLaVA-Instruct-150K](https://huggingface.co/datasets/tabtoyou/KoLLaVA-Instruct-150k) 쀑 Complex resoning에 ν•΄λ‹Ήν•˜λŠ” 77k λ°μ΄ν„°μ…‹μœΌλ‘œ ν•™μŠ΅ν–ˆμŠ΅λ‹ˆλ‹€. Otter 이미지 [데λͺ¨](https://github.com/Luodian/Otter)μ—μ„œ ν•œκ΅­μ–΄ μ§ˆλ¬Έμ„ μ–΄λŠμ •λ„ 이해해 μ˜μ–΄λ‘œ λ‹΅λ³€ν•˜λŠ” 것을 ν™•μΈν•˜κ³ , ν•΄λ‹Ή λͺ¨λΈμ„ κ·ΈλŒ€λ‘œ 가져와 ν•œκ΅­μ–΄ λ°μ΄ν„°μ…‹μœΌλ‘œ ν•™μŠ΅μ΄ λ˜λŠ”μ§€ ν…ŒμŠ€νŠΈν•œ λͺ¨λΈμž…λ‹ˆλ‹€. GPU memory ν•œκ³„λ‘œ Otter의 LLM λΆ€λΆ„μ—μ„œ νŠΉμ • λ ˆμ΄μ–΄ 이상(>25)만 1epoch ν•™μŠ΅ν–ˆμŠ΅λ‹ˆλ‹€. 이 λͺ¨λΈμ€ λ‹΅λ³€μ˜ ν’ˆμ§ˆμ΄ 쒋지 μ•Šμ§€λ§Œ, 더 λ§Žμ€ λ°μ΄ν„°μ…‹μœΌλ‘œ epoch을 늘렀 ν•™μŠ΅ν•œλ‹€λ©΄ 더 쒋은 κ²°κ³Όλ₯Ό 얻을 수 μžˆμ„ κ²ƒμœΌλ‘œ λ³΄μž…λ‹ˆλ‹€.
6
 
7
 
8
  ``` python
 
2
  license: apache-2.0
3
  ---
4
  ### Korean Otter
5
+ [Otter](https://huggingface.co/luodian/OTTER-9B-LA-InContext) λͺ¨λΈμ„ [KoLLaVA-Instruct-150K](https://huggingface.co/datasets/tabtoyou/KoLLaVA-Instruct-150k) 쀑 Complex resoning에 ν•΄λ‹Ήν•˜λŠ” 77k λ°μ΄ν„°μ…‹μœΌλ‘œ ν•™μŠ΅ν–ˆμŠ΅λ‹ˆλ‹€. Otter 이미지 [데λͺ¨](https://github.com/Luodian/Otter)μ—μ„œ ν•œκ΅­μ–΄ μ§ˆλ¬Έμ„ μ–΄λŠμ •λ„ 이해해 μ˜μ–΄λ‘œ λ‹΅λ³€ν•˜λŠ” 것을 ν™•μΈν•˜κ³ , ν•΄λ‹Ή λͺ¨λΈμ„ κ·ΈλŒ€λ‘œ 가져와 ν•œκ΅­μ–΄ λ°μ΄ν„°μ…‹μœΌλ‘œ ν•™μŠ΅μ΄ λ˜λŠ”μ§€ ν…ŒμŠ€νŠΈν•œ λͺ¨λΈμž…λ‹ˆλ‹€. GPU memory ν•œκ³„λ‘œ Otter의 LLM λΆ€λΆ„μ—μ„œ νŠΉμ • λ ˆμ΄μ–΄ 이상(>25)만 1epoch ν•™μŠ΅ν–ˆμŠ΅λ‹ˆλ‹€. 이 λͺ¨λΈμ˜ λ‹΅λ³€ ν€„λ¦¬ν‹°λŠ” 쒋지 μ•Šμ§€λ§Œ, 더 λ§Žμ€ λ°μ΄ν„°μ…‹μœΌλ‘œ epoch을 늘렀 ν•™μŠ΅ν•œλ‹€λ©΄ 더 쒋은 κ²°κ³Όλ₯Ό 얻을 수 μžˆμ„ κ²ƒμœΌλ‘œ λ³΄μž…λ‹ˆλ‹€. μ΄λŸ¬ν•œ κ°€λŠ₯성을 ν™•μΈν–ˆλ‹€λŠ” 것에 μ˜λ―Έκ°€ μžˆλ‹€κ³  생각해 λͺ¨λΈμ„ κ³΅μœ ν•©λ‹ˆλ‹€.
6
 
7
 
8
  ``` python