Header menu link for other important links
X
Efficient Search Mechanism from Large Scale Corpora for Domain-Specific Language Modeling in Speech Recognition
Phull D.K,
Published in Blue Eyes Intelligence Engineering and Sciences Engineering and Sciences Publication - BEIESP
2019
Volume: 8
   
Issue: 6
Pages: 1682 - 1689
Abstract
With the Internet and the World Wide Web revolution, large corpora in variety of forms are germinating ceaselessly that can be manifested as big data. One obligatory area for the usage of such large corpora is language modeling for large vocabulary continuous speech recognition. Language modeling is an indispensable module in speech recognition architecture, which plays a vital role in reducing the search space during the recognition process. Additionally, the language model that is contiguous to the domain of the speech can dwindle the search space and escalate the recognition accuracy. In this paper, an efficient searching mechanism for domain-specific document retrieval from the large corpora has been elucidated using Elasticsearch which is a distributed and an efficient search engine for big data. This assisted us in tuning the language model in accordance with the domain and also by reducing the search time by more than 90% in comparison to conventional search and retrieval mechanism used in our earlier work. A word level and a phrase level retrieval process for creating domain-specific language model has been implemented. The evaluation of the system is performed on the basis of word error rate (WER) and perplexity (PPL) of the speech recognition system. The results shows nearly 10% decrease on WER and a major reduction in the PPL that helped in boosting the performance of the speech recognition process. From the results, it can be consummated that Elasticsearch is an efficient mechanism for domain specific document retrieval from large corpora rather than using topic modeling toolkits
About the journal
JournalInternational Journal of Engineering and Advanced Technology Regular Issue
PublisherBlue Eyes Intelligence Engineering and Sciences Engineering and Sciences Publication - BEIESP
ISSN22498958
Open Access0