1
$\begingroup$

I tried a couple of different websites and libraries. Also found this topic from 3.5 years ago - What are the current open source text-to-audio libraries?

It looks like nobody published anything in the last couple of years and most solutions are really really not good. Even Amazon sounds like some weird robot.

One of the best I tried is Coqui, but their best models were never published to GitHub. So TTS on their website sounds perfect, but you have to pay.

Also, ElevenLabs is amazing, but it is not open-source.

I cannot believe that there are no published models that sound good. I need it to generate a huge amount of text, so it will be very expensive to pay for subscriptions. They all charge about $5/20-40 min of speech and it sounds a little bit too much for me.

Could you recommend anything I can use for free? Preferably open-source, but not mandatory.

Improve this question
$\endgroup$

2 Answers 2

Reset to default
2
$\begingroup$

For me, the go-to source for answering the question "What's the state of the art for [task]?" is Papers with Code. They compile tasks, benchmarks, papers (and their associated official/unofficial implementations) into a series of leaderboards.

Consider, the text-to-speech leaderboard, for example. At the top, you see a series of benchmarks which you can click on to see the top performing papers.

Many popular leaderboards (like the one for TTS) also has a libraries section. These may not be the state of the art, but it'll probably be the easiest to get up and running with.

There are somethings to keep in mind, however.

  1. Take benchmarks with a grain of salt. Especially for something like text-to-speech, where it's difficult to quantify performance into a single number.

  2. Research repositories can be very finnicky. Make sure to look at if data/checkpoints are available. I'd recommend starting with existing, maintained libraries, but if you're looking for the state-of-the-art, this might not be an option. You may be able to email paper authors to request checkpoints/data, if they aren't publically available.

Improve this answer
$\endgroup$
0
$\begingroup$

Check facebook's Massively Multilingual Speech (MMS) : Text-to-Speech Models. You can find it in the HuggingFace repo.

Improve this answer
$\endgroup$
1
  • $\begingroup$ Your answer could be improved with additional supporting information. Please edit to add further details, such as citations or documentation, so that others can confirm that your answer is correct. You can find more information on how to write good answers in the help center. $\endgroup$
    – Community Bot
    Commented Sep 4, 2023 at 0:26

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .