Update README.md
Browse files
README.md
CHANGED
|
@@ -134,6 +134,7 @@ Some examples are shown below.
|
|
| 134 |
- Expanding the vocabulary dictionary size from 32k to 62k to better support Traditional Chinese
|
| 135 |
- 8k-token context length
|
| 136 |
- Multi-turn dialogue (without special handling for harmfulness)
|
|
|
|
| 137 |
|
| 138 |
|
| 139 |
## Inference Performance
|
|
|
|
| 134 |
- Expanding the vocabulary dictionary size from 32k to 62k to better support Traditional Chinese
|
| 135 |
- 8k-token context length
|
| 136 |
- Multi-turn dialogue (without special handling for harmfulness)
|
| 137 |
+
- Sparse mixture of experts (MoE)
|
| 138 |
|
| 139 |
|
| 140 |
## Inference Performance
|