Building on HF

Pankaj Pandey

pankajpandey-dev

AI & ML interests

Natural Language Processing, Text Generation, Large Language Models, Quantization, Fine-Tuning, RLHF, Model Merging

Recent Activity

posted an update about 9 hours ago

🧬 Just uploaded K-quants of Carbon-3B for llama.cpp users! @HuggingFaceBio released the original GGUF in bf16 only — so I added the full quant ladder for CPU/edge inference: • Q2_K → 1.4 GB • Q3_K_M → 1.8 GB • Q4_K_M → 2.1 GB ⭐ • Q5_K_M → 2.4 GB • Q6_K → 2.7 GB • Q8_0 → 3.5 GB 🔗 https://huggingface.co/pankajpandey-dev/Carbon-3B-GGUF Now you can generate DNA sequences on your laptop. Needs a llama.cpp build with PR #23410 (HybridDNATokenizer support). Huge thanks to the HuggingFaceBio team for the original model 🙏 #GGUF #llamacpp #genomics #DNA

updated a collection about 9 hours ago

GGUF Quantizations

updated a model about 9 hours ago

pankajpandey-dev/Carbon-3B-GGUF

View all activity

Organizations

Posts 2

Post

🧬 Just uploaded K-quants of Carbon-3B for llama.cpp users!
@HuggingFaceBio released the original GGUF in bf16 only — so I added the full quant ladder for CPU/edge inference:
• Q2_K → 1.4 GB
• Q3_K_M → 1.8 GB
• Q4_K_M → 2.1 GB ⭐
• Q5_K_M → 2.4 GB
• Q6_K → 2.7 GB
• Q8_0 → 3.5 GB
🔗 pankajpandey-dev/Carbon-3B-GGUF
Now you can generate DNA sequences on your laptop. Needs a llama.cpp build with PR #23410 (HybridDNATokenizer support).
Huge thanks to the HuggingFaceBio team for the original model 🙏
#GGUF #llamacpp #genomics #DNA

Post

172

Just released Qwen3-0.6B fine-tuned on Hindi instruction data 🇮🇳

✅ Full model: pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1
✅ GGUF versions (Q2/Q4/Q5/Q8): pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1-GGUF

Smallest Hindi-capable GGUF — runs on any laptop at 0.37GB.
Next: v2 with more data, better responses.

#Hindi #LLM #GGUF #OpenSource