Conference paper

EGOROVA Ekaterina and SERRANO Jordi Lugue. Semi-Supervised Training of Language Model on Spanish Conversational Telephone Speech Data. In: Procedia Computer Science. Yogyakarta: Elsevier Science, 2016, pp. 114-120. ISSN 1877-0509. Available from:
Publication language:english
Original title:Semi-Supervised Training of Language Model on Spanish Conversational Telephone Speech Data
Title (cs):Částečně kontrolované trénování jazykového modelu pro španělská konverzační telefonní řečová data
Proceedings:Procedia Computer Science
Conference:The 5th International Workshop on Spoken Language Technologies for Under-resourced Languages (SLTU'16)
Place:Yogyakarta, ID
Journal:Procedia Computer Science, Vol. 2016, No. 81, CZ
Publisher:Elsevier Science
Speech recognition, language modeling, semi-supervised learning
This article is about semi-supervised training of language model on Spanish conversational telephone speech data.
This work addresses one of the common issues arising when building a speech recognition system within a low-resourced scenario - adapting the language model on unlabeled audio data. The proposed methodology makes use of such data by means of semisupervised learning. Whilst it has been proven that adding system-generated labeled data for acoustic modeling yields good results, the benefits of adding system-generated sentence hypotheses to the language model are vaguer in the literature. This investigation focuses on the latter by exploring different criteria for picking valuable, well-transcribed sentences. These criteria range from confidence measures at word and sentence level to sentence duration metrics and grammatical structure frequencies. The processing pipeline starts with training a seed speech recognizer using only twenty hours of Fisher Spanish phone call conversations corpus. The proposed procedure attempts to augment this initial system by supplementing it with transcriptions generated automatically from unlabeled data with the use of the seed system. After generating these transcriptions, it is estimated how likely they are, and only the ones with high scores are added to the training data. Experimental results show improvements gained by the use of an augmented language model. Although these improvements are still lesser than those obtained from a system with only acoustic model augmentation, we consider the proposed system (with its low cost in terms of computational resources and the ability for task adaptation) an attractive technique worthy of further exploration.
   author = {Ekaterina Egorova and Lugue Jordi Serrano},
   title = {Semi-Supervised Training of Language Model on Spanish
	Conversational Telephone Speech Data},
   pages = {114--120},
   booktitle = {Procedia Computer Science},
   journal = {Procedia Computer Science},
   volume = {2016},
   number = {81},
   year = {2016},
   location = {Yogyakarta, ID},
   publisher = {Elsevier Science},
   ISSN = {1877-0509},
   language = {english},
   url = {}

Your IPv4 address:
Switch to IPv6 connection

DNSSEC [dnssec]