metadata
license: cc-by-nc-4.0
language:
- en
Fimbulvetr-v2 but extended to 16K with PoSE. A sane context value would be ~12K before it degrades.
I get consistent and reliable answers at ~11K context fine.
Still coherent at up to 16K though! Just works not that well.
Notes:
- I noticed peoplle having bad issues with quants. Be it GGUF or others, at 8 bit or less. Kind of a weird issue? I had little to no issues during testing at the full precision
- Slightly different results from base Fimbulvetr-v2, but during my tests they are similar enough. The vibes are still there.
- Formatting issues happen rarely. Sometimes. A reroll / regenerate fixes it from tests.
