File size: 818 Bytes
12b23b9 9daee60 7033b80 9daee60 7033b80 9daee60 7033b80 9daee60 7033b80 9daee60 7033b80 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 |
---
license: bsd-3-clause
---
# CodeGen (CodeGen-Mono 350M)
Clone of [Salesforce/codegen-350M-mono](https://huggingface.co/Salesforce/codegen-350M-mono) converted to ONNX and optimized.
## Usage
```python
from transformers import AutoTokenizer
from optimum.onnxruntime import ORTModelForCausalLM
model = ORTModelForCausalLM.from_pretrained("TextCortex/codegen-350M-optimized")
tokenizer = AutoTokenizer.from_pretrained("TextCortex/codegen-350M-optimized")
text = "def hello_world():"
input_ids = tokenizer(text, return_tensors="pt").input_ids
generated_ids = model.generate(
input_ids,
max_length=64,
temperature=0.1,
num_return_sequences=1,
early_stopping=True,
)
out = tokenizer.decode(generated_ids[0], skip_special_tokens=True)
print(out)
```
Refer to the original model for more details. |