Vishva R
Vishva007
AI & ML interests
Deeply interested in Generative AI, particularly Large Language Models (LLMs). Focusing on model fine-tuning, prompt engineering, and practical applications using the Hugging Face ecosystem (Transformers, Datasets).
Recent Activity
new activity 1 day ago
nvidia/LocateAnything-3B:Inference support for vLLM and SGLang OpenAI endpoints updated a model 18 days ago
Vishva007/Qwen3.5-9B-W4A16-AutoRound updated a model 22 days ago
Vishva007/gemma-4-E2B-it-W4A16-AutoRoundOrganizations
None yet
Inference support for vLLM and SGLang OpenAI endpoints
➕ 3
#3 opened 1 day ago
by Vishva007
Does Somebody have https://github.com/OLAF-OSS/gemma4-vllm/blob/main/QUANTIZE.md ??
2
#1 opened 26 days ago
by 
Rafik241
Thanks for the gemma4-vllm quantization guide!
#1 opened about 2 months ago
by Vishva007
Can't get the model to run on vllm 0.19.1rc1
1
#1 opened about 2 months ago
by 
toughcent
DFlash compatibility with AutoRound (W4A16) quantized Qwen3.5-9B in vLLM?
2
#1 opened 2 months ago
by Vishva007
Will this model work with an AutoRound-quantized Qwen 3.5 9B model in the vLLM inference engine?
#1 opened 2 months ago
by Vishva007
Update README.md
#23 opened 4 months ago
by Vishva007
How Much GPU Memory (VRAM) is Needed to Run This Model?
🤯 2
6
#3 opened 7 months ago
by Vishva007
[bot] Conversion to Parquet
#1 opened about 1 year ago
by 
parquet-converter
How to output in a Structured format with pydantic model in transformers model?
3
#10 opened over 1 year ago
by Vishva007
How to output in a Structured format with pydantic model in transformers model?
3
#10 opened over 1 year ago
by Vishva007