The output size when deployed in GCP is 1536 instead of 1024
#23
by
bennegeek
- opened
The length of the output is 1536 instead of 1024. I did one click deploy. It doesn't match when i load the model for training and for inference. Could you make the model that loads in TEI also use 1024 dims?
