An Optimization of Neural Network Hyper-Parameter to Increase Its Performance

• 作者: Yinxuan Fu
• 来源期刊: 智能信息管理(英文)
• 学科: 医学
• 关键词: Learning Efficiency NEURAL Network INTERMEDIATE VALUES
• 年，卷（期）: 2018,（4）
• 页码范围: 99-107
• 页数: 9页
• 分类号: R73

摘要

With the boost of artificial intelligence, the study of neural network intrigues scientists. Artificial neural network, which was first designed theoretically in 1943 based on understanding of human brains, demonstrated impressing computational and learning capabilities. In this paper, we investigated the neural network’s learning capability by using a feed-forward neural network to recognize human’s digit hand-writing. Controlled experiments were executed by changing the input values of different parameters, such as learning rates and hidden layer units. After investigating upon the effects of each parameter on the overall learning performance of the neural network, we concluded that, when an intermediate value of one given parameter was implemented, the neural network achieved the highest learning efficiency, and potential problems like over-fitting would be prevented.