CIS Publication Spotlight [Publication Spotlight]
Digital Object Identifier: 10.1109/ TNN.2011.2172628 “In this paper, a novel heuristic dynamic programming (HDP) iteration algorithm is proposed to solve the optimal tracking control problem for a class of nonlinear discrete-time systems with time delays. The novel algorithm contains state updating, control policy iteration, and performance index iteration. To get the optimal states, the states are also updated. Furthermore, the ‘backward iteration’ is applied to state updating. Two neural networks are used to approximate the performance index function and compute the optimal control policy for facilitating the implementation of HDP iteration algorithm. At last, two examples are presented to demonstrate the effectiveness of the proposed HDP iteration algorithm.”