**Contact Info**

Department of Applied Mathematics

University of Waterloo

Waterloo, Ontario

Canada N2L 3G1

Phone: 519-888-4567, ext. 32700

Fax: 519-746-4319

PDF files require Adobe Acrobat Reader

Monday, December 18, 2023 10:00 AM EST

MC 5479

Sounak Majumder | Applied Mathematics, University of Waterloo

Optimal trajectory calculation using neural networks

Optimal control methods for linear systems have reached a substantial level of maturity, both in terms of conceptual understanding and scalable computational implementation. For non-linear systems, an open-loop feedback control may be calculated using Pontryagin's Maximum Principle. Alternatively, the Hamilton-Jacobi-Bellman (HJB) equation may be used to calculate the optimal control in a state-feedback form. However, it is an established fact that this equation becomes progressively harder to solve as the number of state variables increases. In this thesis, we discuss a Neural Network (NN)-based method [1] to approximate the solution to the HJB equation arising from high-dimensional ODE systems. We leverage the equivalency between the HJB equation and Pontryagin's Principle to generate the training and test datasets and define a physics-based loss function. The NN is then trained using a supervised optimization approach. We also examine an existing toolkit [2] to approximate the optimal control based on a power series expansion of the system around an equilibrium point in an infinite time horizon setting. We examine the possibility of incorporating this toolkit in the NN training procedure at different stages. The proposed methods are applied to three problems: optimal control of a 6 degree-of-freedom rigid body and the stabilization of ODE systems arising from the discretization of a Burgers'-like non-linear PDE and the damped wave equation.

References:

[1] Tenavi Nakamura-Zimmerer, Qi Gong, and Wei Kang. Adaptive deep learning for high-dimensional Hamilton-Jacobi-Bellman equations. SIAM Journal of Scientific Computing, 43(2):A1221–A1247, 2021.

[2] Arthur J. Krener. Nonlinear systems toolbox v.1.0, 1997. MATLAB based toolbox available by request from ajkrener@ucdavis.edu

Event tags

**Contact Info**

Department of Applied Mathematics

University of Waterloo

Waterloo, Ontario

Canada N2L 3G1

Phone: 519-888-4567, ext. 32700

Fax: 519-746-4319

PDF files require Adobe Acrobat Reader

University of Waterloo

University of Waterloo

43.471468

-80.544205

200 University Avenue West

Waterloo,
ON,
Canada
N2L 3G1

The University of Waterloo acknowledges that much of our work takes place on the traditional territory of the Neutral, Anishinaabeg and Haudenosaunee peoples. Our main campus is situated on the Haldimand Tract, the land granted to the Six Nations that includes six miles on each side of the Grand River. Our active work toward reconciliation takes place across our campuses through research, learning, teaching, and community building, and is co-ordinated within the Office of Indigenous Relations.