Author(s)

Bin WANG, Jinkuan WANG, Xin SONG, Fulai LIU

.

Cognitive radar is a new framework of radar system proposed by Simon Haykin recently. Adaptive waveform selection is an important problem of intelligent transmitter in cognitive radar. In this paper, the problem of adaptive waveform selection is modeled as stochastic dynamic programming model. Then Q-learning is used to solve it. Q-learning can solve the problems that we do not know the explicit knowledge of state-transition probabilities. The simulation results demonstrate that this method approaches the optimal wave-form selection scheme and has lower uncertainty of state estimation compared to fixed waveform. Finally, the whole paper is summarized.

Waveform Selection; Q-Learning; Space Division; Cognitive Radar

B. WANG, J. WANG, X. SONG and F. LIU, "Q-Learning-Based Adaptive Waveform Selection in Cognitive Radar," International Journal of Communications, Network and System Sciences, Vol. 2 No. 7, 2009, pp. 669-674. doi: 10.4236/ijcns.2009.27077.