Good morning, i have been working on https://github.com/FutureMLS-Lab/OSCAR/tree/zhongzhu/llamacpp , but from your README commands, and I have yet to get a coherent response from teh LLM or it just straight up crashes.
Did you miss any commits?
My fork https://github.com/giveen/llama-cpp-turboquant/tree/oscar
@zzz0906 @InImpasse
Good morning, i have been working on https://github.com/FutureMLS-Lab/OSCAR/tree/zhongzhu/llamacpp , but from your README commands, and I have yet to get a coherent response from teh LLM or it just straight up crashes.
Did you miss any commits?
My fork https://github.com/giveen/llama-cpp-turboquant/tree/oscar
@zzz0906 @InImpasse