Additional projects that might be of interest:

 * [Neural Voice Cloning with a Few Samples - NeurIPS 2018 (Sercan O. Arik, Jitong Chen, Kainan Peng, Wei Ping, Yanqi Zhou)](https://paperswithcode.com/paper/neural-voice-cloning-with-a-few-samples)

A neural voice cloning system is introduced, using a few audio samples to create personalized speech interfaces. Two approaches are explored: speaker adaptation, which fine-tunes a multi-speaker model with cloning samples, and speaker encoding, which trains a separate model to infer new speaker embeddings from cloning audios. Both methods achieve good performance in terms of speech naturalness and similarity to the original speaker. Although speaker adaptation offers better naturalness and similarity, speaker encoding demands less cloning time and memory, making it suitable for low-resource deployment.

Here is an [open-source implementation of the paper](https://github.com/SforAiDl/Neural-Voice-Cloning-With-Few-Samples), but the GitHub page says the project is archived since February 2021 and read-only.

* [Unet-TTS: Improving Unseen Speaker and Style Transfer in One-shot Voice Cloning, arXiv:2109.11115 [cs.SD]](https://github.com/CMsmartvoice/One-Shot-Voice-Cloning)

In this paper, the authors present a novel one-shot voice cloning algorithm called Unet-TTS that has good generalization ability for unseen speakers and styles. Based on a skip-connected U-net structure, the new model can efficiently discover speaker-level and utterance-level spectral feature details from the reference audio, enabling accurate inference of complex acoustic characteristics as well as imitation of speaking styles into the synthetic speech. According to both subjective and objective evaluations of similarity, the new model outperforms both speaker embedding and unsupervised style modeling (GST) approaches on an unseen emotional corpus.

The [GitHub repo](https://github.com/CMsmartvoice/One-Shot-Voice-Cloning/tree/master) has a link to a [Google Colab](https://colab.research.google.com/drive/1sEDvKTJCY7uosb7TvTqwyUdwNPiv3pBW?usp=sharing).

* [ElevenLabs.io](https://beta.elevenlabs.io/)

(Not Open Source, but has a free tier. Voice cloning becomes available in the Starter Tier, starting at 5$/month.)

ElevenLabs initially built new text-to-speech models which rely on high compression and context understanding to render human speech ultra-realistically. Their tools aim to provide the necessary quality for voicing news, newsletters, books and videos. They also offer a suite of tools for __voice cloning__ and designing synthetic voices.

* [BeyondWords.io](https://beyondwords.io)

(Not Open Source, but has a free tier and is a partner of the Open Voice Network, a non-profit industry association dedicated to making voice technology worthy of user trust and it operates as a directed fund of The Linux Foundation.) 

Voice cloning is part of the [enterprise plan](https://beyondwords.io/pricing/#all-features) with custom pricing and requires 2-8 hours of recorded utterances following their script. See an [example of original and cloned voice in English on YouTube](https://www.youtube.com/watch?v=qzVihUH4-4g). Although it sources non-English voices from partners such as Google and Amazon, it does not seem to support voice cloning in languages other than English.



  [1]: https://paperswithcode.com/paper/neural-voice-cloning-with-a-few-samples