metterian commited on
Commit
dd7af75
1 Parent(s): 6840909

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -46,16 +46,16 @@ LLaMA-Pro-Ko's performance is evaluated on two fronts: its proficiency in Englis
46
  | ------------------------------------------------------------ | :------: | :-----------: | :-----------: | ------------- | :-----------: | :----------: |
47
  | [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 20B | 0.7626 | 0.4668 | 0.4657 | 0.8295 | 63.11 |
48
  | [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 40B | **0.7927** | 0.4657 | **0.6977** | 0.7611 | 67.93 |
49
- | [beomi/open-llama-2-ko-7b](https://huggingface.co/beomi/open-llama-2-ko-7b)/ | 15B | 0.7737 | **0.4831** | <u>0.6824</u> | **0.8991** | **70.96** |
50
  | llama-pro-ko-8b | 10B | <u>0.7878</u> | <u>0.4748</u> | 0.6631 | <u>0.8752</u> | <u>70.02</u> |
51
 
52
  **10shot**
53
 
54
- | | # tokens | copa | HellaSwag | boolq | sentiNeg | mean |
55
  | ------------------------------------------------------------ | :------: | :------: | :-------: | :---------: | :---------: | ------------ |
56
  | [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 20B | 0.78 | 0.47 | <u>0.68</u> | 0.87 | 70.12 |
57
  | [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 40B | **0.80** | 0.47 | **0.71** | 0.73 | 67.81 |
58
- | [beomi/open-llama-2-ko-7b](https://huggingface.co/beomi/open-llama-2-ko-7b)/ | 15B | 0.79 | **0.48** | 0.67 | <u>0.94</u> | **71.82** |
59
  | llama-pro-ko-8b | 10B | **0.80** | **0.48** | 0.60 | **0.97** | <u>71.12</u> |
60
 
61
  ### English Evaluation
@@ -66,5 +66,5 @@ LLaMA-Pro-Ko's performance is evaluated on two fronts: its proficiency in Englis
66
  | :----------------------------------------------------------- | :-------: | :----------: | :-------: | :----------: | :----------: | :----------: | :-------: |
67
  | [meta-llama/Llama-2-7b](https://huggingface.co/meta-llama/Llama-2-7b) | 53.07 | **78.59** | 46.87 | **38.76** | **74.03** | **58.26** | 0 |
68
  | [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 48.46 | 75.28 | 39.56 | 34.49 | 72.14 | 53.99 | -4.28 |
69
- | [beomi/open-llama-2-ko-7b](https://huggingface.co/beomi/open-llama-2-ko-7b)/ | 46.84 | 69.48 | 29.86 | 35.35 | 66.30 | 49.57 | -8.70 |
70
  | llama-pro-ko-8b | **53.24** | <u>77.93</u> | **47.06** | <u>38.32</u> | <u>72.22</u> | <u>57.75</u> | **-0.51** |
 
46
  | ------------------------------------------------------------ | :------: | :-----------: | :-----------: | ------------- | :-----------: | :----------: |
47
  | [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 20B | 0.7626 | 0.4668 | 0.4657 | 0.8295 | 63.11 |
48
  | [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 40B | **0.7927** | 0.4657 | **0.6977** | 0.7611 | 67.93 |
49
+ | [beomi/open-llama-2-ko-7b](https://huggingface.co/beomi/open-llama-2-ko-7b) | 15B | 0.7737 | **0.4831** | <u>0.6824</u> | **0.8991** | **70.96** |
50
  | llama-pro-ko-8b | 10B | <u>0.7878</u> | <u>0.4748</u> | 0.6631 | <u>0.8752</u> | <u>70.02</u> |
51
 
52
  **10shot**
53
 
54
+ | | # tokens | copa | HellaSwag | boolq | sentiNeg | AVG |
55
  | ------------------------------------------------------------ | :------: | :------: | :-------: | :---------: | :---------: | ------------ |
56
  | [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 20B | 0.78 | 0.47 | <u>0.68</u> | 0.87 | 70.12 |
57
  | [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 40B | **0.80** | 0.47 | **0.71** | 0.73 | 67.81 |
58
+ | [beomi/open-llama-2-ko-7b](https://huggingface.co/beomi/open-llama-2-ko-7b) | 15B | 0.79 | **0.48** | 0.67 | <u>0.94</u> | **71.82** |
59
  | llama-pro-ko-8b | 10B | **0.80** | **0.48** | 0.60 | **0.97** | <u>71.12</u> |
60
 
61
  ### English Evaluation
 
66
  | :----------------------------------------------------------- | :-------: | :----------: | :-------: | :----------: | :----------: | :----------: | :-------: |
67
  | [meta-llama/Llama-2-7b](https://huggingface.co/meta-llama/Llama-2-7b) | 53.07 | **78.59** | 46.87 | **38.76** | **74.03** | **58.26** | 0 |
68
  | [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b) | 48.46 | 75.28 | 39.56 | 34.49 | 72.14 | 53.99 | -4.28 |
69
+ | [beomi/open-llama-2-ko-7b](https://huggingface.co/beomi/open-llama-2-ko-7b) | 46.84 | 69.48 | 29.86 | 35.35 | 66.30 | 49.57 | -8.70 |
70
  | llama-pro-ko-8b | **53.24** | <u>77.93</u> | **47.06** | <u>38.32</u> | <u>72.22</u> | <u>57.75</u> | **-0.51** |