Tone in speech data
The problem
Standard metrics like Word Error Rate treat two utterances as identical when their letters match — even when pitch and tone change the meaning. In tonal and dialectal languages, that difference is the meaning.
Our approach
We design reward signals and human-feedback protocols that capture pitch contour and dialectal nuance, so a model is rewarded for how a sentence is actually said, not merely how it is spelled.
Open question: What is the right unit of human feedback for a tonal language — phoneme, syllable, or contour?
