Tractable Algorithm for Open Loop Stochastic Control
Raffard, R.L.
Tomlin, C.J.
Aeronaut. & Astronaut., Stanford Univ., Palo Alto, CA;
This paper appears in: Decision and Control, 2006 45th IEEE Conference on
Publication Date: 13-15 Dec. 2006
On page(s): 3222-3227
Location: San Diego, CA,
ISBN: 1-4244-0171-2
INSPEC Accession Number: 9409168
Digital Object Identifier: 10.1109/CDC.2006.377334
Current Version Published: 2007-05-07
Abstract
We present a fast numerical algorithm for open loop control of stochastic differential equations (SDEs). The major difference between this approach and standard stochastic control is that the control process is a deterministic function of time, and not a fully stochastic adapted process. This results in a tremendous gain in computational tractability: the complexity of our algorithm scales as the complexity of optimal control of ordinary differential equations. The algorithm computes the gradient of the cost function with respect to the control function via Monte Carlo sampling of the pathwise gradient. The pathwise gradient is itself computed by solving a set of forward-backward discretized SDEs. Two types of applications are investigated: stochastic system identification and parametric closed loop design
Index
Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.
Cart
