LawItApps/roberta_echr_truncated_facts_all_labels

README.md

@@ -3,6 +3,9 @@ license: mit
 base_model: roberta-base
 tags:
 - generated_from_trainer
+metrics:
+- f1
+- accuracy
 model-index:
 - name: roberta_echr_truncated_facts_all_labels
   results: []
@@ -14,6 +17,11 @@ should probably proofread and complete it, then remove this comment. -->
 # roberta_echr_truncated_facts_all_labels
 
 This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.0674
+- F1: 0.7452
+- Roc Auc: 0.8460
+- Accuracy: 0.5883
 
 ## Model description
 
@@ -33,13 +41,24 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 4
-- eval_batch_size: 4
+- train_batch_size: 8
+- eval_batch_size: 8
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - num_epochs: 5
 
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | F1     | Roc Auc | Accuracy |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|:--------:|
+| 0.0835        | 1.0   | 1765 | 0.0780          | 0.6933 | 0.7942  | 0.5214   |
+| 0.0674        | 2.0   | 3530 | 0.0699          | 0.7375 | 0.8363  | 0.5577   |
+| 0.0584        | 3.0   | 5295 | 0.0674          | 0.7452 | 0.8460  | 0.5883   |
+| 0.0474        | 4.0   | 7060 | 0.0690          | 0.7372 | 0.8448  | 0.5787   |
+| 0.04          | 5.0   | 8825 | 0.0695          | 0.7429 | 0.8475  | 0.5870   |
+
+
 ### Framework versions
 
 - Transformers 4.35.2

config.json

@@ -37,8 +37,7 @@
     "23": "LABEL_23",
     "24": "LABEL_24",
     "25": "LABEL_25",
-    "26": "LABEL_26",
-    "27": "LABEL_27"
+    "26": "LABEL_26"
   },
   "initializer_range": 0.02,
   "intermediate_size": 3072,
@@ -63,7 +62,6 @@
     "LABEL_24": 24,
     "LABEL_25": 25,
     "LABEL_26": 26,
-    "LABEL_27": 27,
     "LABEL_3": 3,
     "LABEL_4": 4,
     "LABEL_5": 5,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:aa395952bb223062e44ed60140de13740adb62f98ca67d1d76806ddd7130fe4d
-size 498692800
+oid sha256:223e614f9a1c81795fe0f429d4478129b2115776e16dfd01eb78143b5f86476d
+size 498689724

runs/Sep01_20-10-26_nql76n3oe5/events.out.tfevents.1725221430.nql76n3oe5.752.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8fbc801ca86e038226b097eb7202899823f34b2d8af907dfc9a578bae3a191d3
+size 10628

runs/Sep01_20-10-26_nql76n3oe5/events.out.tfevents.1725225125.nql76n3oe5.752.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c55db8ad7abd77b1ad86d5396905589d01dfe6ce10bda3ac8d8ab1e5f1ce9344
+size 508

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2f72e5bd54e77557f68a2005ed8d6c46a6a1ca478fcd1a9d2b0e6b1de00f6cb4
+oid sha256:d1582b8461fcd03bb5a189144ff551c85b75ce409a666825437242b08a754679
 size 4664