Publication Details

Neural network based language models for highly inflective languages

MIKOLOV Tomáš, KOPECKÝ Jiří, BURGET Lukáš, GLEMBEK Ondřej and ČERNOCKÝ Jan. Neural network based language models for highly inflective languages. In: Proc. ICASSP 2009. Taipei: IEEE Signal Processing Society, 2009, p. 4. ISBN 978-1-4244-2354-5.
Czech title
Jazykové modely založené na neuronových sítích pro vysoce ohebné jazyky
Type
conference paper
Language
english
Authors
Mikolov Tomáš, Ing. (DCGM FIT BUT)
Kopecký Jiří, Ing. (FIT BUT)
Burget Lukáš, doc. Ing., Ph.D. (DCGM FIT BUT)
Glembek Ondřej, Ing., Ph.D. (DCGM FIT BUT)
Černocký Jan, prof. Dr. Ing. (DCGM FIT BUT)
URL
Keywords

language modeling, neural networks, inflective languages

Abstract

The paper is on neural network based language models for highly inflective languages

Annotation

Speech recognition of inflectional and morphologically rich languages like Czech is currently quite a challenging task, because simple n-gram techniques are unable to capture important regularities in the data. Several possible solutions were proposed, namely class based models, factored models, decision trees and neural networks. This paper describes improvements obtained in recognition of spoken Czech lectures using languagemodels based on neural networks. Relative reductions in word error rate are more than 15% over baseline obtained with adapted 4-gram backoff language model using modified Kneser-Ney smoothing.

Published
2009
Pages
4
Proceedings
Proc. ICASSP 2009
Conference
International Conference on Acoustics, Speech, and Signal Processing , Taipei, TW
ISBN
978-1-4244-2354-5
Publisher
IEEE Signal Processing Society
Place
Taipei, TW
BibTeX
@INPROCEEDINGS{FITPUB9034,
   author = "Tom\'{a}\v{s} Mikolov and Ji\v{r}\'{i} Kopeck\'{y} and Luk\'{a}\v{s} Burget and Ond\v{r}ej Glembek and Jan \v{C}ernock\'{y}",
   title = "Neural network based language models for highly inflective languages",
   pages = 4,
   booktitle = "Proc. ICASSP 2009",
   year = 2009,
   location = "Taipei, TW",
   publisher = "IEEE Signal Processing Society",
   ISBN = "978-1-4244-2354-5",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/9034"
}
Back to top