File size: 662 Bytes
92ca954 e5604ca 92ca954 e5604ca 92b9e2d f81ed14 92b9e2d f81ed14 92b9e2d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 |
---
license: apache-2.0
datasets:
- KBLab/rixvox
language:
- sv
---
# Whisper Large RixVox Swedish
This is a [Whisper large](https://huggingface.co/openai/whisper-large-v2) finetuned for Swedish using the [RixVox](https://huggingface.co/datasets/KBLab/rixvox) dataset.
## Evaluation using [Common Voice 11](#):
* WER: XYZ
* WER (normalized): XYZ
## Training
Training was done using Huggingface and Deepspeed with ZeRO stage 2.
* learning rate: 1e-5
* optimizer: CPUAdamW (Deepspeed)
* lr scheduler: linear
* warmup steps: 500
* per device batch size: 20
* GPUs: 8 x NVIDIA A100 40GB
* total batch size: 160
* steps: 20000
* fp16
* entire decoder was frozen |