Conference paper

DELCROIX Marc, ŽMOLÍKOVÁ Kateřina, KINOSHITA Keisuke, OGAWA Atsunori and NAKATANI Tomohiro. Single Channel Target Speaker Extraction and Recognition with Speaker Beam. In: Proceedings of ICASSP 2018. Calgary: IEEE Signal Processing Society, 2018, pp. 5554-5558. ISBN 978-1-5386-4658-8.
Publication language:english
Original title:Single Channel Target Speaker Extraction and Recognition with Speaker Beam
Title (cs):Extrakce cílového mluvčího z jednoho kanálu a rozpoznávání s paprskem adaptovaným na mluvčího
Pages:5554-5558
Proceedings:Proceedings of ICASSP 2018
Conference:2018 IEEE International Conference on Acoustics, Speech and Signal Processing
Place:Calgary, CA
Year:2018
ISBN:978-1-5386-4658-8
Publisher:IEEE Signal Processing Society
URL:http://www.fit.vutbr.cz/research/groups/speech/publi/2018/delcroix_icassp2018_0005554.pdf [PDF]
Keywords
Speech Recognition, Speech mixtures, Speaker extraction, Adaptation, Robust ASR
Annotation
This paper addresses the problem of single channel speech recognition of a target speaker in a mixture of speech signals. We propose to exploit auxiliary speaker information provided by an adaptation utterance from the target speaker to extract and recognize only that speaker. Using such auxiliary information, we can build a speaker extraction neural network (NN) that is independent of the number of sources in the mixture, and that can track speakers across different utterances, which are two challenging issues occurring with conventional approaches for speech recognition of mixtures. We call such an informed speaker extraction scheme "SpeakerBeam". SpeakerBeam exploits a recently developed context adaptive deep NN (CADNN) that allows tracking speech from a target speaker using a speaker adaptation layer, whose parameters are adjusted depending on auxiliary features representing the target speaker characteristics. SpeakerBeam was previously investigated for speaker extraction using a microphone array. In this paper, we demonstrate that it is also efficient for single channel speaker extraction. The speaker adaptation layer can be employed either to build a speaker adaptive acoustic model that recognizes only the target speaker or a maskbased speaker extraction network that extracts the target speech from the speech mixture signal prior to recognition. We also show that the latter speaker extraction network can be optimized jointly with an acoustic model to further improve ASR performance.
BibTeX:
@INPROCEEDINGS{
   author = {Marc Delcroix and Kate{\v{r}}ina {\v{Z}}mol{\'{i}}kov{\'{a}}
	and Keisuke Kinoshita and Atsunori Ogawa and Tomohiro
	Nakatani},
   title = {Single Channel Target Speaker Extraction and Recognition
	with Speaker Beam},
   pages = {5554--5558},
   booktitle = {Proceedings of ICASSP 2018},
   year = {2018},
   location = {Calgary, CA},
   publisher = {IEEE Signal Processing Society},
   ISBN = {978-1-5386-4658-8},
   language = {english},
   url = {http://www.fit.vutbr.cz/research/view_pub.php?id=11721}
}

Your IPv4 address: 54.224.60.122
Switch to IPv6 connection

DNSSEC [dnssec]