Logo image
Back
A New Method of Cluster-Based Topic Language Model for Genomic IR
Conference proceeding

A New Method of Cluster-Based Topic Language Model for Genomic IR

Jian Wen, Zhoujun Li, Lijuan Zhang, Xiaohua Hu, Huowang Chen and Jin Wen
21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07), v 1, pp 301-306
May 2007
DOI: https://doi.org/10.1109/AINAW.2007.35

Abstract

Bioinformatics Cluster Clustering algorithms Computer science Educational institutions Genomics Information retrieval Information science Optical computing Smoothing methods Solid modeling Topic Language Model
Accurately estimating language model is important to improve the performance of information retrieval. The key problems include solving synonymy and polysemy problem, and smoothing the seen term or not seen term in a document. In this paper, we propose a new method for topic language model. First, concept-based clustering is performed using improved fuzzy c-means. The clustering result is considered as the topics of document collections. The probability of a document generating the topics is estimated by the similarity between the document and each cluster. Then, the probability of the topics generating words is estimated using Expectation Maximization algorithm. At last, we integrate the above algorithms into aspect model to form our topic language model. This new language model accurately describes the distribution probability of the words in different topics and the probability of a document generating a topic. Moreover, it can solve synonymy and polysemy problems. The new method is evaluated on TREC 2004/05 Genomics Track collections. Experiments show that the retrieval performance is greatly improved by the new method compared with the simple language model.

Metrics

12 Record Views
2 citations in Scopus

Details

Logo image