using iq4_xs version, it output "////////////////////////////////" only

by rosspanda0 - opened Feb 25

Feb 25

whatever for reasoning / non reasoning, with/wo mmproj, it output '//////' only

Owner Feb 25

hi! i will check.

i tested latest llama.cpp + ROCm build.(maybe CUDA also works)

Are you using latest llama.cpp + CUDA build?

Feb 25

yes, latest llama.cpp + CUDA build

Owner Feb 25

okay will check.

Owner Feb 26

hi! i release 262b ver please check :)

Feb 26

same all '///'

I confirm everything workiung well for 212B IQ4

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment