Hugging Face's logo

Jacoby746
/
Proto-Harpy-Spark-v0.1-7B

Safetensors
mistral
mergekit
Merge
Eval Results
Model card Files Community
1
Jacoby746 commited on
Commit
47e6be7
•
1 Parent(s): 9b302f4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -8
README.md CHANGED
@@ -21,7 +21,8 @@ model-index:
21
  value: 43.33
22
  name: strict accuracy
23
  source:
24
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
 
25
  name: Open LLM Leaderboard
26
  - task:
27
  type: text-generation
@@ -36,7 +37,8 @@ model-index:
36
  value: 26.91
37
  name: normalized accuracy
38
  source:
39
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
 
40
  name: Open LLM Leaderboard
41
  - task:
42
  type: text-generation
@@ -51,7 +53,8 @@ model-index:
51
  value: 5.82
52
  name: exact match
53
  source:
54
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
 
55
  name: Open LLM Leaderboard
56
  - task:
57
  type: text-generation
@@ -66,7 +69,8 @@ model-index:
66
  value: 7.38
67
  name: acc_norm
68
  source:
69
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
 
70
  name: Open LLM Leaderboard
71
  - task:
72
  type: text-generation
@@ -81,7 +85,8 @@ model-index:
81
  value: 12.29
82
  name: acc_norm
83
  source:
84
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
 
85
  name: Open LLM Leaderboard
86
  - task:
87
  type: text-generation
@@ -98,8 +103,10 @@ model-index:
98
  value: 22.99
99
  name: accuracy
100
  source:
101
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
 
102
  name: Open LLM Leaderboard
 
103
  ---
104
  # merge
105
 
@@ -146,5 +153,4 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
146
  |MATH Lvl 5 (4-Shot)| 5.82|
147
  |GPQA (0-shot) | 7.38|
148
  |MuSR (0-shot) |12.29|
149
- |MMLU-PRO (5-shot) |22.99|
150
-
 
21
  value: 43.33
22
  name: strict accuracy
23
  source:
24
+ url: >-
25
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
26
  name: Open LLM Leaderboard
27
  - task:
28
  type: text-generation
 
37
  value: 26.91
38
  name: normalized accuracy
39
  source:
40
+ url: >-
41
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
42
  name: Open LLM Leaderboard
43
  - task:
44
  type: text-generation
 
53
  value: 5.82
54
  name: exact match
55
  source:
56
+ url: >-
57
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
58
  name: Open LLM Leaderboard
59
  - task:
60
  type: text-generation
 
69
  value: 7.38
70
  name: acc_norm
71
  source:
72
+ url: >-
73
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
74
  name: Open LLM Leaderboard
75
  - task:
76
  type: text-generation
 
85
  value: 12.29
86
  name: acc_norm
87
  source:
88
+ url: >-
89
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
90
  name: Open LLM Leaderboard
91
  - task:
92
  type: text-generation
 
103
  value: 22.99
104
  name: accuracy
105
  source:
106
+ url: >-
107
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Jacoby746/Proto-Harpy-Spark-v0.1-7B
108
  name: Open LLM Leaderboard
109
+ license: apache-2.0
110
  ---
111
  # merge
112
 
 
153
  |MATH Lvl 5 (4-Shot)| 5.82|
154
  |GPQA (0-shot) | 7.38|
155
  |MuSR (0-shot) |12.29|
156
+ |MMLU-PRO (5-shot) |22.99|