About api server
#5
by
Benjamin02
- opened
Hi, really work! BTW, I would like to ask when the 76B model will support api deployment (like the 8B, 26B, 40B version).
You can deploy it as an API server using lmdeploy.
czczup
changed discussion status to
closed