1
$\begingroup$

I am interested in training a machine algorithm to convert the lyrics I give into a song by a particular singer.

My language is non-English (south Indian) The songs are mostly monophonic (very few instruments, if at all). I have data of a bunch of songs sung by this singer, I want to try new lyrics and imagine how to singer would have sung.

$\endgroup$
2
$\begingroup$

OpenAI used a modified version of VQ-VAE-2 combined with sparse transformers to do something similar to what you want to do. Their approach, called Jukebox, is able to produce music by conditioning on certain styles, lyrics, and artists, which you might explore to do what you want. You can explore here the produced songs. For example, the model was able to produce a hip-hop song that uses the lyrics of Eminem's Lose Yourself, but with a Kanye West's style. You can find the original research paper here and the associated codebase here.

$\endgroup$
0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.