openGPT-X/Teuken-7B-instruct-commercial-v0.4 Text Generation • 7B • Updated Dec 11, 2024 • 1.69k • 74
FP8 LLMs for vLLM Collection Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 42 items • Updated Mar 2 • 81