Commit
•
52d2d5a
1
Parent(s):
580661e
Update README.md (#1)
Browse files- Update README.md (678ee62407363bcf519cd74bf19ff16318c33d15)
Co-authored-by: Amir Sartipi <Amir13@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -315,7 +315,7 @@ Documentation on installing and using vLLM [can be found here](https://vllm.read
|
|
| 315 |
### Using vLLM as a server ###
|
| 316 |
When using vLLM as a server, pass the --model amazon/MistralLite parameter, for example:
|
| 317 |
```shell
|
| 318 |
-
python3
|
| 319 |
```
|
| 320 |
|
| 321 |
### Using vLLM in Python Code ###
|
|
|
|
| 315 |
### Using vLLM as a server ###
|
| 316 |
When using vLLM as a server, pass the --model amazon/MistralLite parameter, for example:
|
| 317 |
```shell
|
| 318 |
+
python3 -m vllm.entrypoints.api_server --model amazon/MistralLite
|
| 319 |
```
|
| 320 |
|
| 321 |
### Using vLLM in Python Code ###
|