Commit
•
062129f
1
Parent(s):
b8b6ef9
Update README.md
Browse files
README.md
CHANGED
|
@@ -15,4 +15,6 @@ PROMPT_TEMPLATE = (
|
|
| 15 |
"下面是描述一项任务的指令，并且与一则输入配对用来提供更多的上下文。请给出尽可能满足请求的回答.\n"
|
| 16 |
"### 指令:\n{instruction}\n### 输入:\n{input}\n### 回答:\n"
|
| 17 |
)
|
| 18 |
-
```
|
|
|
|
|
|
|
|
|
| 15 |
"下面是描述一项任务的指令，并且与一则输入配对用来提供更多的上下文。请给出尽可能满足请求的回答.\n"
|
| 16 |
"### 指令:\n{instruction}\n### 输入:\n{input}\n### 回答:\n"
|
| 17 |
)
|
| 18 |
+
```
|
| 19 |
+
|
| 20 |
+
We use a sequence length of 1k for pre-training, and continue training based on this length during the fine-tuning stage. Based on a larger base period of RoPE, it can support up 15k context length extrapolation at inference time.
|