TigerResearch
/

tigerbot-7b-sft-v1-4bit

Text Generation

Inference Endpoints

Model card Files Files and versions Community

vivicai commited on Jun 13, 2023

Commit

0f8b141

•

1 Parent(s): 5483954

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -35,6 +35,6 @@ Inference with command line interface
 ```
 cd TigerBot/gptq
-CUDA_VISIBLE_DEVICES=0 python tigerbot_infer.py TigerResearch/tigerbot-7b-sft-4bit-128g --wbits 4 --groupsize 128 --load tigerbot-7b-4bit-128g.pt
 ```

 ```
 cd TigerBot/gptq
+CUDA_VISIBLE_DEVICES=0 python tigerbot_infer.py TigerResearch/tigerbot-7b-sft-4bit-128g --wbits 4 --groupsize 128 --load TigerResearch/tigerbot-7b-sft-4bit-128g/tigerbot-7b-4bit-128g.pt
 ```