File size: 763 Bytes
6b78503
b7fc0ad
 
 
 
 
 
 
6b78503
b7fc0ad
 
 
6b78503
b7fc0ad
 
 
 
4ea6cc2
446c8ea
4ea6cc2
 
 
446c8ea
4ea6cc2
446c8ea
cdb8bcd
b2f8992
 
 
c5ff4c5
cdb8bcd
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
---
language:
- en
tags:
- pytorch
- text-generation
- causal-lm
- rwkv
license: apache-2.0
datasets:
- the_pile

---

# RWKV-4 "Raven"-series Models

## Model Description

These are RWKV-4-Pile models finetuned on Alpaca, CodeAlpaca, Guanaco, GPT4All.

Gradio Demo: https://huggingface.co/spaces/BlinkDL/Raven-RWKV-7B

Use https://github.com/BlinkDL/ChatRWKV to run them.

See https://github.com/BlinkDL/RWKV-LM for details on the RWKV Language Model (100% RNN).

* RWKV-4-Raven-v6-Eng (99% English + 1% Multilang)
* RWKV-4-Raven-v6-EngChnJpn (98% English + 1% Chn Jpn + 1% Multilang)
* RWKV-4-Raven-v6-ChnEng (40% English + 60% Chinese)

Previous Raven models are in:
https://huggingface.co/BlinkDL/rwkv-4-pile-7b
https://huggingface.co/BlinkDL/rwkv-4-pile-14b