unusable
#4
by Skorcht - opened
talks as user with your config exlama 4bpw
Try enabling wrap sequences with newline. Plenty of people are running the model without issue, and i run it myself daily since launch with the 4bpw exl2 i provided.
Nitral-AI changed discussion status to closed