bongsoo
/

kpf-sbert-v1

Sentence Similarity

sentence-transformers

feature-extraction

text-embeddings-inference

Inference Endpoints

Model card Files Files and versions Community

bongsoo commited on Feb 10, 2023

Commit

106f6c6

•

1 Parent(s): f2ddf3c

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -37,7 +37,7 @@ For an automated evaluation of this model, see the *Sentence Embeddings Benchmar
 The model was trained with the parameters:
 **공통**
-- **do_lower_case=1, correct_bios=0, polling_mode=cls**
 **1.STS**
 - 말뭉치 : korsts(5,749) + kluestsV1.1(11,668) + stsb_multi_mt(5,749) + mteb/sickr-sts(9,927) + glue stsb(5,749) (총:38,842)
@@ -47,7 +47,7 @@ The model was trained with the parameters:
 **2.distilation**
 - 교사 모델 : paraphrase-multilingual-mpnet-base-v2(max_token_len:128)
 - 말뭉치 : news_talk_en_ko_train.tsv (영어-한국어 대화-뉴스 병렬 말뭉치 : 1.38M)
-- Param : **lr: 5e-5, epochs: 10, train_batch: 128, eval/test_batch: 64, max_token_len: 128(교사모델이 128이므로 맟춰줌)**
 - 훈련코드 [여기](https://github.com/kobongsoo/BERT/blob/master/sbert/sbert-distillaton.ipynb) 참조
 **3.NLI**

 The model was trained with the parameters:
 **공통**
+- **do_lower_case=1, correct_bios=0, polling_mode=mean**
 **1.STS**
 - 말뭉치 : korsts(5,749) + kluestsV1.1(11,668) + stsb_multi_mt(5,749) + mteb/sickr-sts(9,927) + glue stsb(5,749) (총:38,842)
 **2.distilation**
 - 교사 모델 : paraphrase-multilingual-mpnet-base-v2(max_token_len:128)
 - 말뭉치 : news_talk_en_ko_train.tsv (영어-한국어 대화-뉴스 병렬 말뭉치 : 1.38M)
+- Param : **lr: 5e-5, eps: 1e-8, epochs: 10, train_batch: 128, eval/test_batch: 64, max_token_len: 128(교사모델이 128이므로 맟춰줌)**
 - 훈련코드 [여기](https://github.com/kobongsoo/BERT/blob/master/sbert/sbert-distillaton.ipynb) 참조
 **3.NLI**