audreyt
/

Taiwan-LLaMa-v1.0-GGUF

Text Generation

Model card Files Files and versions Community

audreyt commited on Aug 29, 2023

Commit

a7415c6

•

1 Parent(s): 2cdd801

* chase upstream bd959f3

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -157,7 +157,7 @@ The scores are calculated with ChatGPT as the baseline, represented as 100%. The
 ## How to deploy the model on my own machine?
 We recommend hosting models with [🤗 Text Generation Inference](https://github.com/huggingface/text-generation-inference). Please see their [license](https://github.com/huggingface/text-generation-inference/blob/main/LICENSE) for details on usage and limitations.
 ```bash
-bash run_text_generation_inference.sh "yentinglin/Taiwan-LLaMa" NUM_GPUS DIR_TO_SAVE_MODEL PORT MAX_INPUT_LEN MODEL_MAX_LEN
 ```
 Prompt format follows vicuna-v1.1 template:

 ## How to deploy the model on my own machine?
 We recommend hosting models with [🤗 Text Generation Inference](https://github.com/huggingface/text-generation-inference). Please see their [license](https://github.com/huggingface/text-generation-inference/blob/main/LICENSE) for details on usage and limitations.
 ```bash
+bash run_text_generation_inference.sh "yentinglin/Taiwan-LLaMa-v1.0" NUM_GPUS DIR_TO_SAVE_MODEL PORT MAX_INPUT_LEN MODEL_MAX_LEN
 ```
 Prompt format follows vicuna-v1.1 template: