I am making my speech recognition project for PC (working on Windows 8) and am new in this area. The project should have basic functionality like dictation with accuracy in email, notepad, etc., and should respond to local commands of PC.

I am using sphinx4 for my speech recognition project. I'm trying to determine if there is there is a better open source API than CMU Sphinx in terms of accuracy and large vocabulary?

Does Kaldi (deep neural network based) perform better than CMU Sphinx (HMM based)? Are the two platforms better for different kinds of applications?


I want to increase my speech recognition system accuracy and vocabulary. Which might be most optimal: Kaldi or CMU Sphinx?

Also wondering what is the difference between a speech API and a speech Engine, and, more generally, as a developer what I will require to develop my software?

Please help me to get a clear understanding about above questions and, if possible, provide some speech recognition developer or researcher community links.

Any and all comments, suggestions and answers are welcome!

  • 1
    $\begingroup$ Welcome to stackexchange ai. This is a site, where one question is one question, not many at once. Please reformat your question. $\endgroup$ – mico Jan 10 '18 at 14:34
  • $\begingroup$ I want to increase my speech recognition system accuracy and vocabulary.Which is better,kaldi or CMU sphinx? $\endgroup$ – musarrat.jhan Jan 11 '18 at 10:12

The difference between a Speech API and a Speech Engine is: Speech API's enable developers to integrate speech recognition technologies into developer apps. On the other hand a speech engine is software that gives your computer the ability to play back text in a spoken voice. (Source msdn library)

Below is a list of speech recognition tool-kits and their features.

Tensorflow - Although tensorflow doesn't arrive packaged with speech recognition libraries by default. You can use seq2seq models which have achieved high levels of accuracy in speech recognition. A few of the advantages of using tensorflow for speech recognition include: It comes with tensorboard which is useful in visualising and fine-tuning your network, it's architecture is highly modular which allows you to experiment with different voice libraries and finally it is portable meaning you can run it on GPU's, CPU's, servers or even mobile computing platforms.

Microsoft's CNTK - Microsofts Cognitive Toolkit delivers excellent results when it come to speech recognition. In recent times CNTK has outperformed humans in transcribing speech to text. Some of its perks are its efficient resource usage additionally it was originally built for speech recognition systems and consequently it is very effective at working with time series data.

CMU Sphinx - CMU Sphinx is a speech recognition system developed at Carnegie Mellon University. The advantages of using CMU Sphinx are: it is multilingual and supports most international languages, it has excellent commercial support, it has a light mobile version called pocketsphinx, it has a wide range of tools for different purposes i.e. keyword spotting, alignment and pronunciation evaluation. It also enjoys active support from the Carnegie Mellon University.

Kaldi - Kaldi aims to provide speech recognition software that is flexible and extensible. Kaldi has powerful features such as pipelines that are highly optimized for parallel computing i.e. training models on the GPU. Additionally it supports speaker identification and detection of errors in transcripts.

Mozilla Deep Speech - This project aims at providing speech interfaces for the web. This project achieved a word error rate on LibriSpeech's test-clean of 6.5% which is commendable.

I found this paper comparing open source speech recognition toolkits to be relevant to your question http://suendermann.com/su/pdf/oasis2014.pdf

Siraj Raval has an excellent tensorflow speech recognition tutorial. It is available here https://github.com/llSourcell/tensorflow_speech_recognition_demo

| improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.