Relaxing dynamic programming
Författare
Summary, in English
The idea of dynamic programming is general and very simple, but the "curse of dimensionality" is often prohibitive and restricts the fields of application. This paper introduces a method to reduce the complexity by relaxing the demand for optimality. The distance from optimality is kept within prespecified bounds and the size of the bounds determines the computational complexity. Several computational examples are considered. The first is optimal switching between linear systems, with application to design of a dc/dc voltage converter. The second is optimal control of a linear system with piecewise linear cost with application to stock order control. Finally, the method is applied to a partially observable Markov decision problem (POMDP).
Avdelning/ar
Publiceringsår
2006
Språk
Engelska
Sidor
1249-1260
Publikation/Tidskrift/Serie
IEEE Transactions on Automatic Control
Volym
51
Issue
8
Dokumenttyp
Artikel i tidskrift
Förlag
IEEE - Institute of Electrical and Electronics Engineers Inc.
Ämne
- Control Engineering
Nyckelord
- optimal control
- dynamic programming
- nonlinear synthesis
- switching
- systems
Status
Published
ISBN/ISSN/Övrigt
- ISSN: 0018-9286