Improving the Collocation Extraction Method Using an Untagged Corpus for Persian Word Sense Disambiguation

HTML  XML Download Download as PDF (Size: 448KB)  PP. 109-124  
DOI: 10.4236/jcc.2016.44010    1,985 Downloads   3,154 Views  Citations

ABSTRACT

Word sense disambiguation is used in many natural language processing fields. One of the ways of disambiguation is the use of decision list algorithm which is a supervised method. Supervised methods are considered as the most accurate machine learning algorithms but they are strongly influenced by knowledge acquisition bottleneck which means that their efficiency depends on the size of the tagged training set, in which their preparation is difficult, time-consuming and costly. The proposed method in this article improves the efficiency of this algorithm where there is a small tagged training set. This method uses a statistical method for collocation extraction from a big untagged corpus. Thus, the more important collocations which are the features used for creation of learning hypotheses will be identified. Weighting the features improves the efficiency and accuracy of a decision list algorithm which has been trained with a small training corpus.

Share and Cite:

Riahi, N. and Sedghi, F. (2016) Improving the Collocation Extraction Method Using an Untagged Corpus for Persian Word Sense Disambiguation. Journal of Computer and Communications, 4, 109-124. doi: 10.4236/jcc.2016.44010.

Copyright © 2024 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.