JeongwonChoi commited on
Commit
5e53c97
1 Parent(s): f7cc58c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -9
README.md CHANGED
@@ -48,15 +48,13 @@ text = """\
48
 
49
  ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
50
 
51
- On Benchmarking ...
52
-
53
- | Task | 0-shot | 5-shot | 10-shot | 50-shot |
54
- | :--------------- | ------: | ------: | ------: | ------: |
55
- | kobest_boolq | 0.0 | 0.0 | 0.0 | 0.0 |
56
- | kobest_copa | 0.0 | 0.0 | 0.0 | 0.0 |
57
- | kobest_hellaswag | 0.0 | 0.0 | 0.0 | 0.0 |
58
- | kobest_sentineg | 0.0 | 0.0 | 0.0 | 0.0 |
59
- | **Average** | **0.0** | **0.0** | **0.0** | **0.0** |
60
 
61
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
62
 
 
48
 
49
  ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
50
 
51
+ | Task | 0-shot | 5-shot | 10-shot | 50-shot |
52
+ | :--------------- | -----------: | -----------: | -----------: | -----------: |
53
+ | kobest_boolq | 0.757911 | 0.907177 | 0.924496 | 0.605075 |
54
+ | kobest_copa | 0.740605 | 0.801886 | 0.831886 | 0.849978 |
55
+ | kobest_hellaswag | 0.445176 | 0.454788 | 0.468654 | 0.45218 |
56
+ | kobest_sentineg | 0.415445 | 0.95214 | 0.962217 | 0.967254 |
57
+ | **Average** | **0.589784** | **0.778998** | **0.796813** | **0.718622** |
 
 
58
 
59
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
60