Complex Valued Recurrent Neural Network: From Architecture to Training

• 作者: Alexey Minin Alois Knoll Hans-Georg Zimmermann
• 来源期刊: 信号与信息处理(英文)
• 学科: 数学
• 关键词: COMPLEX VALUED NEURAL NETWORKS COMPLEX VALUED System Identification RECURRENT NEURAL NETWORKS COMPLEX VALUED RECURRENT NEURAL NETWORKS
• 年，卷（期）: 2012,（2）
• 页码范围: 192-197
• 页数: 6页
• 分类号: O1

摘要

Recurrent Neural Networks were invented a long time ago, and dozens of different architectures have been published. In this paper we generalize recurrent architectures to a state space model, and we also generalize the numbers the network can process to the complex domain. We show how to train the recurrent network in the complex valued case, and we present the theorems and procedures to make the training stable. We also show that the complex valued recurrent neural network is a generalization of the real valued counterpart and that it has specific advantages over the latter. We conclude the paper with a discussion of possible applications and scenarios for using these networks.