Prompt format

#2
by lightning-missile - opened

Hi,
Downloading now. What is the correct prompt format to use? Because from this discussion on luminum (https://huggingface.co/FluffyKaeloky/Luminum-v0.1-123B/discussions/3) there are two formats that are used by mistral-large, magnum and luminum.
Mistral Large and Magnum uses:
[INST] {input}[/INST] {output}
Luminaid and Luminum uses:
[INST] {input} [/INST] {output}
Which format does Lumikabra follow?

I personally use the one from the Magnum template, but I wasn't aware about the difference. Thank you, I will test both and make a note in the readme.

EDIT:
After trying both formats, i'd say the answers WITH space tend to be longer then the answers without space before [/INST]. I'd put that result into the category: personal taste. It clearly depends on what you are looking for.

Sign up or log in to comment