3 contributors

History: 23 commits

yangapku

update int8 quantization info

2468096 12 months ago

assets
update modeling_qwen.py about 1 year ago
examples
update react_prompt.md 12 months ago
.gitattributes

1.52 kB

update model about 1 year ago
LICENSE

6.9 kB

update batch infer about 1 year ago
NOTICE

2.7 kB

update batch infer about 1 year ago
README.md

34.5 kB

update int8 quantization info 12 months ago
cache_autogptq_cuda_256.cpp

8.4 kB

update kernels about 1 year ago
cache_autogptq_cuda_kernel_256.cu

52 kB

update kernels about 1 year ago
config.json

910 Bytes

update model about 1 year ago
configuration_qwen.py

2.35 kB

softmax_in_fp32 about 1 year ago
cpp_kernels.py

1.92 kB

update kernels about 1 year ago
generation_config.json

249 Bytes

update default generate hyperparams 12 months ago
model-00001-of-00008.safetensors

1.96 GB
LFS

update model about 1 year ago
model-00002-of-00008.safetensors

2.02 GB
LFS

update model about 1 year ago
model-00003-of-00008.safetensors

2.02 GB
LFS

update model about 1 year ago
model-00004-of-00008.safetensors

2.02 GB
LFS

update model about 1 year ago
model-00005-of-00008.safetensors

2.02 GB
LFS

update model about 1 year ago
model-00006-of-00008.safetensors

2.02 GB
LFS

update model about 1 year ago
model-00007-of-00008.safetensors

2.02 GB
LFS

update model about 1 year ago
model-00008-of-00008.safetensors

1.33 GB
LFS

update model about 1 year ago
model.safetensors.index.json

19.5 kB

update model about 1 year ago
modeling_qwen.py

57.6 kB

update modeling_qwen.py 12 months ago
qwen.tiktoken

2.56 MB

update model about 1 year ago
qwen_generation_utils.py

14.6 kB

update model about 1 year ago
tokenization_qwen.py

9.62 kB

update tokenization.py 12 months ago
tokenizer_config.json

173 Bytes

format 12 months ago