Update README.md
Browse files
README.md
CHANGED
@@ -14,6 +14,19 @@ datasets:
|
|
14 |
- https://huggingface.co/datasets/TigerResearch/sft_zh
|
15 |
- https://huggingface.co/datasets/silk-road/alpaca-data-gpt4-chinese
|
16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
|
18 |
### 结果
|
19 |
| 模型名称 | CEVAL | MMLU |
|
|
|
14 |
- https://huggingface.co/datasets/TigerResearch/sft_zh
|
15 |
- https://huggingface.co/datasets/silk-road/alpaca-data-gpt4-chinese
|
16 |
|
17 |
+
### 训练工具
|
18 |
+
https://github.com/hiyouga/LLaMA-Factory
|
19 |
+
|
20 |
+
### 测评方式:
|
21 |
+
使用opencompass(https://github.com/open-compass/OpenCompass/ ), 测试工具基于CEval和MMLU对微调之后的模型和原始模型进行测试。</br>
|
22 |
+
测试模型分别为:
|
23 |
+
- Llama-3-8B
|
24 |
+
- Llama-3-8B-Instruct
|
25 |
+
- LLama3-Instruct-sft-lora-tigerbot-alpacadatagpt4,使用sft_zh、alpaca-data-gpt4-chinese数据对Llama-3-8B-Instruct使用sft方式lora微调
|
26 |
+
|
27 |
+
### 测试机器
|
28 |
+
8*A800
|
29 |
+
|
30 |
|
31 |
### 结果
|
32 |
| 模型名称 | CEVAL | MMLU |
|