Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
second-state
/
functionary-small-v3.2-GGUF
like
0
GGUF
llama
custom_code
Inference Endpoints
conversational
License:
mit
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
f062a52
functionary-small-v3.2-GGUF
1 contributor
History:
4 commits
apepkuss79
Update README.md
f062a52
verified
10 days ago
.gitattributes
2.43 kB
Update models
10 days ago
README.md
4.44 kB
Update README.md
10 days ago
config.json
1.04 kB
Update models
10 days ago
functionary-small-v3.2-Q2_K.gguf
3.18 GB
LFS
Update models
10 days ago
functionary-small-v3.2-Q3_K_L.gguf
4.32 GB
LFS
Update models
10 days ago
functionary-small-v3.2-Q3_K_M.gguf
4.02 GB
LFS
Update models
10 days ago
functionary-small-v3.2-Q3_K_S.gguf
3.66 GB
LFS
Update models
10 days ago
functionary-small-v3.2-Q4_0.gguf
4.66 GB
LFS
Update models
10 days ago
functionary-small-v3.2-Q4_K_M.gguf
4.92 GB
LFS
Update models
10 days ago
functionary-small-v3.2-Q4_K_S.gguf
4.69 GB
LFS
Update models
10 days ago
functionary-small-v3.2-Q5_0.gguf
5.6 GB
LFS
Update models
10 days ago
functionary-small-v3.2-Q5_K_M.gguf
5.73 GB
LFS
Update models
10 days ago
functionary-small-v3.2-Q5_K_S.gguf
5.6 GB
LFS
Update models
10 days ago
functionary-small-v3.2-Q6_K.gguf
6.6 GB
LFS
Update models
10 days ago
functionary-small-v3.2-Q8_0.gguf
8.54 GB
LFS
Update models
10 days ago
functionary-small-v3.2-f16.gguf
16.1 GB
LFS
Update models
10 days ago