SC-GlowTTS: an Efficient Zero-Shot Multi-Speaker Text-To-Speech Model
Published in Interspeech, 2021
Recommended citation: Casanova, E., Shulby, C.D., Gölge, E., Müller, N.M., Oliveira, F.S., Júnior, A.C., Soares, A.D., Aluísio, S.M., & Ponti, M.A. (2021). "SC-GlowTTS: an Efficient Zero-Shot Multi-Speaker Text-To-Speech Model". "Interspeech". https://www.isca-speech.org/archive/pdfs/interspeech_2021/casanova21b_interspeech.pdf
In this paper, we propose SC-GlowTTS: an efficient zero-shot multi-speaker text-to-speech model that improves similarity for speakers unseen during training. We propose a speaker-conditional architecture that explores a flow-based decoder that works in a zero-shot scenario. As text encoders, we explore a dilated residual convolutional-based encoder, gated convolutional-based encoder, and transformer-based encoder. Additionally, we have shown that adjusting a GAN-based vocoder for the spectrograms predicted by the TTS model on the training dataset can significantly improve the similarity and speech quality for new speakers. Our model converges using only 11 speakers, reaching state-of-the-art results for similarity with new speakers, as well as high speech quality.
Bibtex:
@article{casanova2021sc, title={Sc-glowtts: an efficient zero-shot multi-speaker text-to-speech model}, author={Casanova, Edresson and Shulby, Christopher and G{"o}lge, Eren and M{"u}ller, Nicolas Michael and de Oliveira, Frederico Santos and Junior, Arnaldo Candido and Soares, Anderson da Silva and Aluisio, Sandra Maria and Ponti, Moacir Antonelli}, journal={arXiv preprint arXiv:2104.05557}, year={2021} }