File size: 676 Bytes
92ca954 e5604ca 92ca954 e5604ca 68d0121 ab95894 92b9e2d c0e1e70 92b9e2d 2b4e504 92b9e2d f81ed14 92b9e2d 36cae7e ab95894 f81ed14 15aff64 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 |
---
license: apache-2.0
datasets:
- KBLab/rixvox
language:
- sv
---
# Whisper Large RixVox Swedish
This is a [Whisper large](https://huggingface.co/openai/whisper-large-v2) finetuned for Swedish using
the [RixVox](https://huggingface.co/datasets/KBLab/rixvox) dataset.
## Evaluation
### [Common Voice 11](#):
* WER: XYZ
* WER (normalized): XYZ
## Training
Training was done using Huggingface and Deepspeed with ZeRO stage 2.
* learning rate: 1e-5
* optimizer: CPUAdamW (Deepspeed)
* lr scheduler: linear
* warmup steps: 500
* per device batch size: 20
* GPUs: 8 x NVIDIA A100 40GB
* total batch size: 160
* steps: 12000
* lowercase: no
* fp16
* entire encoder was frozen |