1
$\begingroup$

I am interested in training a machine algorithm to convert the lyrics I give into a song by a particular singer.

My language is non-English (south Indian) The songs are mostly monophonic (very few instruments, if at all). I have data of a bunch of songs sung by this singer, I want to try new lyrics and imagine how to singer would have sung.

Improve this question
$\endgroup$

1 Answer 1

Reset to default
2
$\begingroup$

OpenAI used a modified version of VQ-VAE-2 combined with sparse transformers to do something similar to what you want to do. Their approach, called Jukebox, is able to produce music by conditioning on certain styles, lyrics, and artists, which you might explore to do what you want. You can explore here the produced songs. For example, the model was able to produce a hip-hop song that uses the lyrics of Eminem's Lose Yourself, but with a Kanye West's style. You can find the original research paper here and the associated codebase here.

Improve this answer
$\endgroup$
0

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .