Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mobiuslabsgmbh
/
Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ
like
15
Text Generation
Transformers
mixtral
Mixture of Experts
conversational
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
main
Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ
2 contributors
History:
13 commits
mobicham
Update README.md
78ace90
verified
7 months ago
.gitattributes
1.52 kB
update qmodel with gs=128
7 months ago
README.md
5.15 kB
Update README.md
7 months ago
config.json
773 Bytes
update qmodel with gs=128
7 months ago
qmodel.pt
18.3 GB
LFS
update qmodel with gs=128
7 months ago
special_tokens_map.json
414 Bytes
update qmodel with gs=128
7 months ago
tokenizer.json
1.8 MB
update qmodel with gs=128
7 months ago
tokenizer.model
493 kB
LFS
update qmodel with gs=128
7 months ago
tokenizer_config.json
1.46 kB
update qmodel with gs=128
7 months ago