跳到主要导航 跳到搜索 跳到主要内容

An efficient minimum vocabulary construction algorithm for language modeling

  • Beihang University
  • Boston University

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

In learning a new word by a dictionary, we first need to know a set of "basic words" which are frequently appeared in word definitions. It often happens that you cannot understand the word you looked up because there are still some words you do not understand in its definitions or explanations provided by the dictionary. You can keep looking up these new words recursively till they all can be well explained by some basic words you already knew. How to automatically find a minimum set of such basic words to define (or recursively define) the entire vocabulary in a given dictionary is what are going to discuss in this paper. We propose an efficient algorithm to construct the Minimum Vocabulary (MV) using the word frequency information. The minimum vocabulary can be used for language modeling and experimental results demonstrate the effectiveness of using the minimum vocabulary as features in text classification.

源语言英语
主期刊名Advanced Research in Applied Artificial Intelligence - 25th International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2012, Proceedings
292-301
页数10
DOI
出版状态已出版 - 2012
活动25th International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2012 - Dalian, 中国
期限: 9 6月 201212 6月 2012

出版系列

姓名Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
7345 LNAI
ISSN(印刷版)0302-9743
ISSN(电子版)1611-3349

会议

会议25th International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2012
国家/地区中国
Dalian
时期9/06/1212/06/12

指纹

探究 'An efficient minimum vocabulary construction algorithm for language modeling' 的科研主题。它们共同构成独一无二的指纹。

引用此