intervitens
commited on
Commit
•
c743c40
1
Parent(s):
0ef3039
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,41 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
- fr
|
6 |
+
- de
|
7 |
+
- es
|
8 |
+
- it
|
9 |
+
- pt
|
10 |
+
- ru
|
11 |
+
- zh
|
12 |
+
- ja
|
13 |
+
---
|
14 |
+
|
15 |
+
This model is the miniature version of [alpindale/magnum-72b-v1](https://huggingface.co/alpindale/magnum-72b-v1), a second entry in a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet and Opus. This model is fine-tuned on top of [Mistral-Nemo-Base-2407](https://huggingface.co/mistralai/Mistral-Nemo-Base-2407).
|
16 |
+
|
17 |
+
|
18 |
+
## Prompting
|
19 |
+
Model has been Instruct tuned with the Mistral formatting. A typical input would look like this:
|
20 |
+
|
21 |
+
```py
|
22 |
+
"""[INST] Hi there! [/INST]
|
23 |
+
Nice to meet you!
|
24 |
+
[INST] Can I ask a question? [/INST]
|
25 |
+
|
26 |
+
"""
|
27 |
+
```
|
28 |
+
|
29 |
+
## Credits
|
30 |
+
|
31 |
+
This model has been a team effort, credits go to:
|
32 |
+
|
33 |
+
- [Sao10K](https://huggingface.co/Sao10K) and [kalomaze](https://huggingface.co/kalomaze) for help with (and cleaning up!) the dataset.
|
34 |
+
- [alpindale](https://huggingface.co/alpindale) for the training.
|
35 |
+
- Various other people for their continued help as we tuned the parameters, restarted failed runs. In no particular order: [Doctor Shotgun](https://huggingface.co/Doctor-Shotgun), [Lucy](https://huggingface.co/lucyknada), [Nopm](https://huggingface.co/nopm), [Mango](https://huggingface.co/MangoMango69420), [Intervitens](https://huggingface.co/intervitens), and the rest of the Silly Tilly.
|
36 |
+
|
37 |
+
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
38 |
+
|
39 |
+
## Safety
|
40 |
+
...
|
41 |
+
|