Hugging Face's logo

LPN64
/
LongCite-llama3.1-8b-GGUF

Text Generation
GGUF
imatrix
importance matrix
llama.cpp
Inference Endpoints
conversational
Model card Files Community
LPN64 commited on
Commit
044e8ad
•
1 Parent(s): 1065fe8

Updated gguf with chat template metadatas

Browse files
Files changed (11) hide show
  1. LongCite-llama3.1-8B-F16.gguf +2 -2
  2. LongCite-llama3.1-8B-IQ3_M.gguf +2 -2
  3. LongCite-llama3.1-8B-Q4_K_M.gguf +2 -2
  4. LongCite-llama3.1-8B-Q5_K_M.gguf +2 -2
  5. LongCite-llama3.1-8B-Q6_K.gguf +2 -2
  6. LongCite-llama3.1-8B-Q8_0.gguf +2 -2
  7. LongCite-llama3.1-8B-imat-IQ3_M.gguf +2 -2
  8. LongCite-llama3.1-8B-imat-Q4_K_M.gguf +2 -2
  9. LongCite-llama3.1-8B-imat-Q5_K_M.gguf +2 -2
  10. LongCite-llama3.1-8B-imat-Q6_K.gguf +2 -2
  11. LongCite-llama3.1-8B-imat-Q8_0.gguf +2 -2
LongCite-llama3.1-8B-F16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7eef6314edca6fcc9814af950b98d0200854ae7ff9c0af79db758a292b8c4173
3
- size 16068891104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c91d8314a6f3775c266fe14de226281d16c7d720278292ca1e45a63cacd3027
3
+ size 16068895744
LongCite-llama3.1-8B-IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6486f9a8647e59d5710d9a9cbac7b6dcfc08f953554695dc1619df9d7c57c571
3
- size 3784823264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb9be2458facf2074fb5975911a0cd0935e220e80d44492796459290e5a030e7
3
+ size 3784827904
LongCite-llama3.1-8B-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ad6590725c948bd24e05b32df1a1cc045854643610dce717fb75182d18517314
3
- size 4920734176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f01f323bfe6e88a06e4df0cbfa73728c363d2e0ee973d7ed1b5897c54cae2eb
3
+ size 4920738816
LongCite-llama3.1-8B-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ab0143652ad84b986f6b336ad1da5815901487409cf1ddf5fa94c372db640d95
3
- size 5732987360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c336a2d391b76408d3014d0e67125b7d53e1f7394409e5fd00a3ff2c651428b4
3
+ size 5732992000
LongCite-llama3.1-8B-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1f454003b697629ab03c0006664bfb90b05d1e94b91118d9ee06a452e900aa0e
3
- size 6596006368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02a07bf2e8f86c07b85585bdb20126eeed8aa3638100c0892d6bca8da7eb66f1
3
+ size 6596011008
LongCite-llama3.1-8B-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9df035e6d0bef4f4308df21b772c081022fe5d25de1ea65475a0d43e453e0643
3
- size 8540770784
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9590bf828dcfecd759f2644edf3a65f2cb6e99c864783530bcf2f97b120e5125
3
+ size 8540775424
LongCite-llama3.1-8B-imat-IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7355e9560c07c3c19a92c6ba8a2fc075e91069adf7e6f24bb3acd924a013a155
3
- size 3784823488
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71c32e6fcadedc855185cfb80810d06af292464de9436cda616d6722b7a701f8
3
+ size 3784828160
LongCite-llama3.1-8B-imat-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:95712799626075eae715940ebb1c4de47d393700cbbc093e255c0b485e36d66a
3
- size 4920734400
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a54cdd1fccc9e76c74859614a2e217f2689f55737f20c50487b1b0ef6fff908a
3
+ size 4920739072
LongCite-llama3.1-8B-imat-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4d51e03b6d9ab060b30291e9c62b816365e7d3f370bbba3c4dd157a5e447d35
3
- size 5732987584
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83c83a1d221f568549e28556629c640f5365bf975e52df033f5a56815f673e89
3
+ size 5732992256
LongCite-llama3.1-8B-imat-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f601b93443d3fd0ca60807322d180f91317605807ee2f91e8d9c7b88290e1bf6
3
- size 6596006592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f40f155df6d8742bf8e61f46ce06d8458f43c0bd5e1c6169598462ad330cb2a1
3
+ size 6596011264
LongCite-llama3.1-8B-imat-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:931bcd93c531a0327c95a07fca33332fb9a35dacf112eaff5b5114622450e063
3
- size 8540771008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8647efa703a9b561a0808d6e04d342f1da49082aa9c92e3906df66e23b6a8334
3
+ size 8540775680