Mathematical Expression Extraction in Text Fields of Documents Based on HMM

• 作者: Fang Yang Jinyuan Bai Ruihan Bai Xinfu Li Xuedong Tian
• 来源期刊: 电脑和通信(英文)
• 学科: 数学
• 关键词: Mathematical Expression EXTRACTION Hidden MARKOV Model TEXT FIELDS DOCUMENTS SYMBOL Combination Features
• 年，卷（期）: 2017,（14）
• 页码范围: 1-13
• 页数: 13页
• 分类号: O1

摘要

Aiming at the problem that the mathematical expressions in unstructured text fields of documents are hard to be extracted automatically, rapidly and effectively, a method based on Hidden Markov Model (HMM) is proposed. Firstly, this method trained the HMM model through employing the symbol combination features of mathematical expressions. Then, some preprocessing works such as removing labels and filtering words were carried out. Finally, the preprocessed text was converted into an observation sequence as the input of the HMM model to determine which is the mathematical expression and extracts it. The experimental results show that the proposed method can effectively extract the mathematical expressions from the text fields of documents, and also has the relatively high accuracy rate and recall rate.