MMLU Pro benchmark for GGUFs (1 shot)
Collection
"Not all quantized model perform good", serving framework ollama uses NVIDIA gpu, llama.cpp uses CPU with AVX & AMX • 13 items • Updated
• 9
Patterson
MartinPatterson
AI & ML interests
None yet
Recent Activity
new activity
about 4 hours ago
unsloth/MiniMax-M2.5-GGUF:Can you guys do Cerebras' Minimax M2.1 139B REAP? new activity
3 months ago
unsloth/MiniMax-M2-GGUF:Could we possibly get (Unsloth) MiniMax-M2-REAP-139B-A10B-GGUF new activity
4 months ago
Intel/GLM-4.6-REAP-218B-A32B-FP8-gguf-q2ks-mixed-AutoRound:auto round version plz Organizations
None yet
upvoted a collection 4 months ago