To deploy in Sagemaker

#18
by lsatish - opened

I see that instructions to deploy the model in the AWS Sagmaker. The sample code has version 1.2.3 where as gte-large model is supported from 1.3.0 onwards.

# create Hugging Face Model Class
huggingface_model = HuggingFaceModel(
    image_uri=get_huggingface_llm_image_uri("huggingface-tei",version="1.2.3"),
    env=hub,
    role=role, 
)

To fix this use the following code to create Hugginfface_model


# create Hugging Face Model Class
huggingface_model = HuggingFaceModel(
    image_uri=get_huggingface_llm_image_uri("huggingface-tei",version="1.4.0"),
    env=hub,
    role=role, 
)

Sign up or log in to comment