Paragraph Vector Representation Based on Word to Vector and CNN Learning

• 作者: Chenyang Zhu Qiangqiang Shen Yijie Wang Zeyu Xiong
• 来源期刊: 计算机、材料和连续体(英文)
• 学科: 工学
• 关键词: DISTRIBUTED WORD VECTOR DISTRIBUTED PARAGRAPH VECTOR CNNS CBOW deep learning.
• 年，卷（期）: 2018,（5）
• 页码范围: 213-227
• 页数: 15页
• 分类号: TP3

摘要

Document processing in natural language includes retrieval,sentiment analysis,theme extraction,etc.Classical methods for handling these tasks are based on models of probability,semantics and networks for machine learning.The probability model is loss of semantic information in essential,and it influences the processing accuracy.Machine learning approaches include supervised,unsupervised,and semi-supervised approaches,labeled corpora is necessary for semantics model and supervised learning.The method for achieving a reliably labeled corpus is done manually,it is costly and time-consuming because people have to read each document and annotate the label of each document.Recently,the continuous CBOW model is efficient for learning high-quality distributed vector representations,and it can capture a large number of precise syntactic and semantic word relationships,this model can be easily extended to learn paragraph vector,but it is not precise.Towards these problems,this paper is devoted to developing a new model for learning paragraph vector,we combine the CBOW model and CNNs to establish a new deep learning model.Experimental results show that paragraph vector generated by the new model is better than the paragraph vector generated by CBOW model in semantic relativeness and accuracy.