Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,7 @@ widget:
|
|
9 |
|
10 |
# roberta-base-ko
|
11 |
|
12 |
-
A roberta model trained from the scratch. It has almost the same structure as [roberta-base](roberta-base), but with a few differences.
|
13 |
|
14 |
- hidden_act: `mish`
|
15 |
-
- position_embedding_type:
|
|
|
9 |
|
10 |
# roberta-base-ko
|
11 |
|
12 |
+
A roberta model trained from the scratch. It has almost the same structure as [roberta-base](https://huggingface.co/roberta-base), but with a few differences.
|
13 |
|
14 |
- hidden_act: `mish`
|
15 |
+
- position_embedding_type: `relative_key_query`
|