The outliers in speech include three types:
- syntax errors,
- semantic errors, and
- errors in pragmatics.
I wonder if we can borrow the techniques from computer vision (CV) to tackle that, such as Fréchet Audio Distance inspired by the Fréchet Inception Distance in CV. In the paper on Fréchet Audio Distance, FID is applied to music, but the language would be much more complicated.