Publication Details

On the Usage of Phonetic Information for Text-independent Speaker Embedding Extraction

WANG Shuai, ROHDIN Johan A., BURGET Lukáš, PLCHOT Oldřich, QIAN Yanmin, YU Kai and ČERNOCKÝ Jan. On the Usage of Phonetic Information for Text-independent Speaker Embedding Extraction. In: Proceedings of Interspeech. Graz: International Speech Communication Association, 2019, pp. 1148-1152. ISSN 1990-9772. Available from: https://www.isca-speech.org/archive/Interspeech_2019/pdfs/3036.pdf
Czech title
O využití fonetické informace pro na textu nezávislou extrakci embeddingů popisujících řečníka
Type
conference paper
Language
english
Authors
Wang Shuai (DCGM FIT BUT)
Rohdin Johan A., Dr. (DCGM FIT BUT)
Burget Lukáš, doc. Ing., Ph.D. (DCGM FIT BUT)
Plchot Oldřich, Ing., Ph.D. (DCGM FIT BUT)
Qian Yanmin (SJTU)
Yu Kai (SJTU)
Černocký Jan, prof. Dr. Ing. (DCGM FIT BUT)
URL
Keywords

phonetic information, text-independent speaker verification, adversarial training

Abstract

Embeddings extracted by deep neural networks have become the state-of-the-art utterance representation in speaker recognition systems. It has recently been shown that incorporating frame-level phonetic information in the embedding extractor can improve the speaker recognition performance. On the other hand, in the final embedding, phonetic information is just an additional source of session variability which may be harmful to the text-independent speaker recognition task. This suggests that at the embedding level phonetic information should be suppressed rather than encouraged. To verify this hypothesis, we perform several experiments that encourage or/and suppress phonetic information at various stages in the network. Our experiments confirm that multitask learning is beneficial if it is applied at the frame-level stage of the network, whereas adversarial training is beneficial if it is used at the segment-level stage of the network. Additionally, the combination of these two approaches improves the performance further, resulting in an equal error rate of 3.17% on the VoxCeleb dataset.

Published
2019
Pages
1148-1152
Journal
Proceedings of Interspeech - on-line, vol. 2019, no. 9, ISSN 1990-9772
Proceedings
Proceedings of Interspeech
Conference
Interspeech Conference, Graz, AT
Publisher
International Speech Communication Association
Place
Graz, AT
DOI
10.21437/Interspeech.2019-3036
UT WoS
000831796401061
EID Scopus
2-s2.0-85074688607
BibTeX 
@INPROCEEDINGS{FITPUB12087,
   author = "Shuai Wang and A. Johan Rohdin and Luk\'{a}\v{s} Burget and Old\v{r}ich Plchot and Yanmin Qian and Kai Yu and Jan \v{C}ernock\'{y}",
   title = "On the Usage of Phonetic Information for Text-independent Speaker Embedding Extraction",
   pages = "1148--1152",
   booktitle = "Proceedings of Interspeech",
   journal = "Proceedings of Interspeech - on-line",
   volume = 2019,
   number = 9,
   year = 2019,
   location = "Graz, AT",
   publisher = "International Speech Communication Association",
   ISSN = "1990-9772",
   doi = "10.21437/Interspeech.2019-3036",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/12087"
}
Back to top