Text Generation
Safetensors
English
llama
esper
esper-2
valiant
valiant-labs
llama-3.2
llama-3.2-instruct
llama-3.2-instruct-3b
llama-3
llama-3-instruct
llama-3-instruct-3b
3b
code
code-instruct
python
dev-ops
terraform
azure
aws
gcp
architect
engineer
developer
conversational
chat
instruct
Eval Results
eval
Browse files
README.md
CHANGED
|
@@ -49,6 +49,18 @@ model-index:
|
|
| 49 |
- type: acc
|
| 50 |
value: 65.27
|
| 51 |
name: acc
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
model_type: llama
|
| 53 |
license: llama3.2
|
| 54 |
---
|
|
|
|
| 49 |
- type: acc
|
| 50 |
value: 65.27
|
| 51 |
name: acc
|
| 52 |
+
- task:
|
| 53 |
+
type: text-generation
|
| 54 |
+
name: Text Generation
|
| 55 |
+
dataset:
|
| 56 |
+
name: ARC Challenge (25-Shot)
|
| 57 |
+
type: arc-challenge
|
| 58 |
+
args:
|
| 59 |
+
num_few_shot: 25
|
| 60 |
+
metrics:
|
| 61 |
+
- type: acc_norm
|
| 62 |
+
value: 43.17
|
| 63 |
+
name: normalized accuracy
|
| 64 |
model_type: llama
|
| 65 |
license: llama3.2
|
| 66 |
---
|