SparseGPT LLMs - a nm-testing Collection

nm-testing 's Collections

KV Cache Quantization

FP8-Block Quantized Models

LLM Compressor testing

Speculators testing

Sparse-Llama-3.1-8B-2of4

SparseGPT LLMs

updated Nov 17, 2025

RedHatAI/Nous-Hermes-2-Yi-34B-pruned50

Text Generation • Updated Mar 5, 2024 • 18
RedHatAI/Nous-Hermes-2-Yi-34B-pruned2.4

Text Generation • Updated Mar 5, 2024 • 19
RedHatAI/Nous-Hermes-2-SOLAR-10.7B-pruned2.4

Text Generation • Updated Mar 5, 2024 • 15
RedHatAI/OpenHermes-2.5-Mistral-7B-pruned50

Text Generation • Updated Mar 5, 2024 • 14 • 1
RedHatAI/OpenHermes-2.5-Mistral-7B-pruned2.4

Text Generation • Updated Mar 5, 2024 • 14
RedHatAI/MiniChat-2-3B-pruned2.4

Text Generation • Updated Mar 5, 2024 • 26
RedHatAI/TinyLlama-1.1B-Chat-v1.0-pruned2.4

Text Generation • Updated about 1 month ago • 2.79k • • 1
RedHatAI/llama2.c-stories110M-pruned2.4

Text Generation • Updated Mar 5, 2024 • 21
RedHatAI/llama2.c-stories110M-pruned50

Text Generation • Updated Mar 5, 2024 • 2.51k
RedHatAI/phi-2-pruned50

Text Generation • 3B • Updated Mar 5, 2024 • 26