Really useful, thanks.
#1
by
Delcos
- opened
title. Please make more soon.
how much VRAM does running this model take, i have been crashing with a 3070ti running oogabooga text-gen, if there's anything i can change to make it work, please let me know, thanks in advance
how much VRAM does running this model take, i have been crashing with a 3070ti running oogabooga text-gen, if there's anything i can change to make it work, please let me know, thanks in advance
4.5 GB without context, ~7.8 with full context