jgrosjean commited on
Commit
31d002d
1 Parent(s): 1471909

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -9
README.md CHANGED
@@ -162,15 +162,17 @@ Note: For French and Italian, the training data remains in German, while the tes
162
 
163
  Making use of an unsupervised training approach, Swissbert for Sentence Embeddings achieves comparable results as the best-performing multilingual Sentence-BERT model in the semantic textual similarity task for German and outperforms it in the French text classification task.
164
 
165
- | Evaluation task |swissbert | |swissbert for SE| |
166
- |------------------------|----------|---------|----------------|---------|
167
- | |accuracy |f1-score |accuracy |f1-score |
168
- | Semantic Similarity DE | 83.80 | - |**87.70** | - |
169
- | Semantic Similarity FR | 82.30 | - |**84.02** | - |
170
- | Semantic Similarity IT | 83.00 | - |**84.00** | - |
171
- | Text Classification DE | 95.76 |**91.99**| 94.70 | 89.43 |
172
- | Text Classification FR | 94.55 | 88.52 | 95.30 |**89.91**|
173
- | Text Classification IT | 93.48 | 88.29 | 94.85 |**90.36**|
 
 
174
 
175
  #### Baseline
176
 
 
162
 
163
  Making use of an unsupervised training approach, Swissbert for Sentence Embeddings achieves comparable results as the best-performing multilingual Sentence-BERT model in the semantic textual similarity task for German and outperforms it in the French text classification task.
164
 
165
+ | Evaluation task |swissbert | |sentence swissbert| |all-mpnet-base-v2| |
166
+ |------------------------|----------|---------|------------------|---------|-----------------|---------|
167
+ | |accuracy |f1-score |accuracy |f1-score |accuracy |f1-score |
168
+ | Semantic Similarity DE | 83.80 | - |**93.70** | - | 87.70 | - |
169
+ | Semantic Similarity FR | 82.30 | - |**92.90** | - | 91.10 | - |
170
+ | Semantic Similarity IT | 83.00 | - |**91.20** | - | 89.80 | - |
171
+ | Semantic Similarity RM | 78.80 | - |**90.80** | - | 67.90 | - |
172
+ | Text Classification DE | 95.76 | 91.99 | 96.36 |**92.11**| 95.61 | 91.20 |
173
+ | Text Classification FR | 94.55 | 88.52 | 95.76 |**90.94**| 94.55 | 89.82 |
174
+ | Text Classification IT | 93.48 | 88.29 | 95.44 | 90.44 | 95.91 |**92.05**|
175
+ | Text Classification RM | | | | | | |
176
 
177
  #### Baseline
178