Anthony Mikinka's picture

Anthony Mikinka

anthonymikinka

·

https://anthonymikinka.com

AI & ML interests

ANE Focused

Recent Activity

upvoted an article about 23 hours ago

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

reacted to mitkox's post with 👍 1 day ago

I just pushed Claude Code Agent Swarm with 20 coding agents on my desktop GPU workstation. With local AI, I don’t have /fast CC switch, but I have /absurdlyfast: - 100’499 tokens/second read, yeah 100k, not a typo | 811 tok/sec generation - KV cache: 707’200 tokens - Hardware: 5+ year old GPUs 4xA6K gen1; It’s not the car. It’s the driver. Qwen3 Coder Next AWQ with cache at BF16. Scores 82.1% in C# on 29-years-in-dev codebase vs Opus 4.5 at only 57.5%. When your codebase predates Stack Overflow, you don't need the biggest model; you need the one that actually remembers Windows 95. My current bottleneck is my 27" monitor. Can't fit all 20 Theos on screen without squinting.

liked a model 3 days ago

mradermacher/KAT-Dev-GGUF

View all activity

Organizations

None yet

anthonymikinka 's datasets

None public yet