mayaeary

/

pygmalion-6b-4bit-128g

like 39

Hi, thank you for your great contribution.

How can I load and use the model?

I can't load with 2 following code:

from diffusers import DiffusionPipeline
pipeline = DiffusionPipeline.from_pretrained("mayaeary/pygmalion-6b-4bit-128g", use_safetensors=True)

or:

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("mayaeary/pygmalion-6b-4bit-128g")
model = AutoModelForCausalLM.from_pretrained("mayaeary/pygmalion-6b-4bit-128g")

Thank you very much!!!