Q-Learning-Based Adaptive Waveform Selection in Cognitive Radar

• 作者: Bin WANG Fulai LIU Jinkuan WANG Xin SONG
• 来源期刊: 通讯、网络与系统学国际期刊(英文)
• 学科: 医学
• 关键词: WAVEFORM SELECTION Q-LEARNING Space DIVISION COGNITIVE RADAR
• 年，卷（期）: 2009,（7）
• 页码范围: 669-674
• 页数: 6页
• 分类号: R73

摘要

Cognitive radar is a new framework of radar system proposed by Simon Haykin recently. Adaptive waveform selection is an important problem of intelligent transmitter in cognitive radar. In this paper, the problem of adaptive waveform selection is modeled as stochastic dynamic programming model. Then Q-learning is used to solve it. Q-learning can solve the problems that we do not know the explicit knowledge of state-transition probabilities. The simulation results demonstrate that this method approaches the optimal wave-form selection scheme and has lower uncertainty of state estimation compared to fixed waveform. Finally, the whole paper is summarized.