Design and Implementation of a New Chinese Word Segmentation Dictionary for the Personalized Mobile Search

• 作者: Jingna Qi Yan He Zhongmin Wang
• 来源期刊: 通讯与网络(英文)
• 学科: 工学
• 关键词: Chinese WORD SEGMENTATION DICTIONARY Mechanism Natural LANGUAGE Processing PERSONALIZED SEARCH WORD Classification Information
• 年，卷（期）: 2013,（1）
• 页码范围: 81-85
• 页数: 5页
• 分类号: TP39

摘要

Chinese word segmentation is the basis of natural language processing. The dictionary mechanism significantly influences the efficiency of word segmentation and the understanding of the user’s intention which is implied in the user’s query. As the traditional dictionary mechanisms can't meet the present situation of personalized mobile search, this paper presents a new dictionary mechanism which contains the word classification information. This paper, furthermore, puts forward an approach for improving the traditional word bank structure, and proposes an improved FMM segmentation algorithm. The results show that the new dictionary mechanism has made a significant increase on the query efficiency and met the user’s individual requirements better.