Will it work with ooba?
#5
by
lhucklen
- opened
Will this quant work with Ooba? Previous ones did not.
short answer: not yet.
Ooba uses llama cpp python, which will need to update with gemma support at which point you could update the requirments yourself to make it work or wait for ooba to update to use the latest llama cpp python
Just updated ooba and now it works!