
Karu — AI VTuber Live-Stream
My biggest personal project: a Thai-speaking AI VTuber, inspired by Neuro-sama. Karu listens to my voice and reads YouTube live chat, thinks in her own personality, then talks back with a cloned voice and a Live2D avatar. She can co-host with me or run a segment on her own. Her Thai still comes out clunky sometimes, and I improve her a little with every stream.
- ▸Real-time pipeline: speech-to-text (faster-whisper), a persona LLM, Thai voice-clone TTS (F5-TTS) with emotion tags, and Live2D lip-sync, all streamed through OBS
- ▸Memory system: embedding retrieval, pinned facts, and daily self-generated 'thoughts'
- ▸Fine-tuned a local LLM on a dialogue dataset I built by hand (QLoRA to GGUF, served with Ollama)
- Python
- PyTorch
- OpenAI API
- Ollama
- Q+LoRA
- F5-TTS
- faster-whisper
- Node.js







































