dranger003
/

Smaug-72B-v0.1-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on Feb 11

Commit

16ca049

•

1 Parent(s): 94c1535

Update README.md

Files changed (1) hide show

README.md +3 -0

README.md CHANGED Viewed

@@ -3,4 +3,7 @@ license: other
 license_name: tongyi-qianwen-license-agreement
 license_link: >-
   https://github.com/QwenLM/Qwen/blob/main/Tongyi%20Qianwen%20LICENSE%20AGREEMENT
 ---

 license_name: tongyi-qianwen-license-agreement
 license_link: >-
   https://github.com/QwenLM/Qwen/blob/main/Tongyi%20Qianwen%20LICENSE%20AGREEMENT
+pipeline_tag: text-generation
 ---
+GGUF importance matrix (imatrix) quants for https://huggingface.co/abacusai/Smaug-72B-v0.1
+The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.