Update README.md

README.md

@@ -70,7 +70,7 @@ The 4 bit GPTQ quant has small quality degradation from the original `bfloat16`
 
 | Branch | Bits | Group Size | Act Order | Damp % | GPTQ Dataset | Sequence Length | VRAM Size | ExLlama | Description |
 | ------ | ---- | -- | --------- | ------ | ------------ | ------- | ---- | ------- | ---- |
-| [main](https://huggingface.co/astronomer-io/Llama-3-8B-Instruct-GPTQ-4-Bit/tree/main) | 4 | 128 | Yes | 0.1 | [wikitext](https://huggingface.co/datasets/wikitext/viewer/wikitext-2-v1/test) | 8192 | 5.74 GB | Yes | 4-bit, with Act Order and group size 128g. Smallest Model possible with tiny accuracy loss | 
+| [main](https://huggingface.co/astronomer-io/Llama-3-8B-Instruct-GPTQ-4-Bit/tree/main) | 4 | 128 | Yes | 0.1 | [wikitext](https://huggingface.co/datasets/wikitext/viewer/wikitext-2-v1/test) | 8192 | 5.74 GB | Yes | 4-bit, with Act Order and group size 128g. Smallest model possible with small accuracy loss | 
 | More variants to come | TBD | TBD | TBD | TBD | TBD | TBD | TBD | TBD | May upload additional variants of GPTQ 4 bit models in the future using different parameters such as 128g group size and etc. |
 
 ## Serving this GPTQ model using vLLM
@@ -82,9 +82,9 @@ python -m vllm.entrypoints.openai.api_server --model astronomer-io/Llama-3-8B-In
 ```
 For the non-stop token generation bug, make sure to send requests with `stop_token_ids":[128001, 128009]` to vLLM endpoint
 Example:
-```
+```json
 {
-    "model": "Llama-3-8B-Instruct-GPTQ-4-Bit",
+    "model": "astronomer-io/Llama-3-8B-Instruct-GPTQ-4-Bit",
     "messages": [
         {"role": "system", "content": "You are a helpful assistant."},
         {"role": "user", "content": "Who created Llama 3?"}