Y. He and E. K. P. Chong, “Sensor scheduling for target tracking in sensor networks,” 43rd IEEE Conference on Decision and Control, Paradise, Island, Bahamas, pp. 743–748, 2004.

has been cited by the following article:

• TITLE: Q-Learning-Based Adaptive Waveform Selection in Cognitive Radar

  AUTHORS: Bin WANG, Jinkuan WANG, Xin SONG, Fulai LIU

  KEYWORDS: Waveform Selection; Q-Learning; Space Division; Cognitive Radar

  JOURNAL NAME: International Journal of Communications, Network and System Sciences, Vol.2 No.7, October 21, 2009

  ABSTRACT: Cognitive radar is a new framework of radar system proposed by Simon Haykin recently. Adaptive waveform selection is an important problem of intelligent transmitter in cognitive radar. In this paper, the problem of adaptive waveform selection is modeled as stochastic dynamic programming model. Then Q-learning is used to solve it. Q-learning can solve the problems that we do not know the explicit knowledge of state-transition probabilities. The simulation results demonstrate that this method approaches the optimal wave-form selection scheme and has lower uncertainty of state estimation compared to fixed waveform. Finally, the whole paper is summarized.