ISTA-DASLab
/

Qwen2-72B-Instruct-AQLM-PV-2bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

性能损失

#1

by evonexusx - opened 27 days ago

27 days ago

请问有测过量化后的性能损失吗，会出现乱吐字，循环输出等糟糕的情况吗？

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment