OppaAI/Aiko-data
660 MB
OppaAI
OppaAI
AI & ML interests
Local AI implementation, Agentic AI workflows, AI Autonomous Robot
Recent Activity
updated a bucket 1 day ago
OppaAI/Aiko-data posted an update 3 days ago
My AI Waifu's architecture has grown too complicate.
Even ask AI to help me gen a simplified version of the diagram is still so complicated.
I know I'm too ambitious to build such a complicated local AI workflow with small AI models in limited resource of Jetson Orin Nano 8GB.
I don't know if it would work, but the foundation of harness architecture is there.
Here are the models I'm currently using
Main LLM: Ministral3-3B-Instruct UD-Q4_K_XL (Multimodal: text, tool call, vision, 8K context -> preferably 16K)
Helper LLM: SmolLM2-135M (Agentic Routing, Memory Extraction)
Embedding model: Harrier-OSS-v1-270M (Memory, RAG, Semantic Routing)
ASR model: SenseVoice (English, Japanese, Cantonese , Mandarin, Korean)
TTS model: MioTTS-0.4B-Q4KM + synthesize (English, Japanese with voice cloning preset)
That's 4GB + 0.5GB x 3 + 2GB = ~7.5GB out of 7.4GB available in Jetson
PS: Mistral family models especially such a small param LLM tends to hallucinate all the time. But actually the hallucinations did give my AI Waifu a somewhat poetic tone in her tone. Also it also has vision and tool call capabilities, so I guess I have to live with the hallucinations.
posted an update 8 days ago
For those who is interested in my AI Waifu Project,
the one I submitted to HuggingFace Hackathon with Gradio front-end and back-end running in Modal is just a demo.
The actual project is even more exciting.
Here is a preview of my AI Waifu close to completion in Phase 2.
Just need the fix the voice input/output issues.
She's still lost when agentic workflow got too complicated and need to be addressed in Phase 2.5
The code is Open-source and available here:
👉GitHub: https://github.com/OppaAI/Aiko-chan
Organizations
