Aso Oke
In developmentYoruba speech-to-text & translation · Solo, built in public
I measured the baseline first, then built against it: a custom Yoruba diacritic normalizer validated on 200 real corpus sentences, a licensed data pipeline (FLEURS, MAFAND, Tatoeba, FLORES-200), and a pre-registered three-path ship gate written before any result existed.
The most interesting outcome is the one that didn't go to plan. An 8-epoch LoRA fine-tune of Whisper large-v3 reached 61.4% WER and failed the pre-registered gate. Meta's Omnilingual ASR LLM 1B, used with zero Yoruba-specific training, scored 32.0% — and shipped. I chose the baseline over my own model, and documented exactly why.
- 32.0% WER on held-out FLEURS test (817 clips) vs a 92.6% baseline
- 27.7% WER on own-speaker holdout — evidence the score isn't inflated by data leakage
- 4.12s p95 latency for one clip on a single T4
- 60.6 points better than the un-fine-tuned baseline