File size: 762 Bytes
6b78503 b7fc0ad 6b78503 b7fc0ad 6b78503 b7fc0ad 4ea6cc2 fc06392 4ea6cc2 446c8ea 4ea6cc2 446c8ea cdb8bcd 22bcd84 fc06392 4045978 c5ff4c5 641a084 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 |
---
language:
- en
tags:
- pytorch
- text-generation
- causal-lm
- rwkv
license: apache-2.0
datasets:
- the_pile
---
# RWKV-4 "Raven"-series Models
## Model Description
These are RWKV-4-Pile models 3B/7B/14B finetuned on Alpaca, CodeAlpaca, Guanaco, GPT4All, ShareGPT and more. Ctxlen 8192 in v9.
Gradio Demo: https://huggingface.co/spaces/BlinkDL/Raven-RWKV-7B
Use https://github.com/BlinkDL/ChatRWKV to run them.
See https://github.com/BlinkDL/RWKV-LM for details on the RWKV Language Model (100% RNN).
* RWKV-4-Raven-Eng : 99% English + 1% Multilang
* RWKV-4-Raven-EngAndMore (v7 v8) : 97% English + 1.5% Chn Jpn + 1.5% Multilang (More Jpn than v6 "EngChnJpn")
* RWKV-4-Raven-ChnEng : 49.5% English + 50% Chinese + 0.5% Multilang
License: Apache 2.0
|