**Contact Info**

Department of Applied Mathematics

University of Waterloo

Waterloo, Ontario

Canada N2L 3G1

Phone: 519-888-4567, ext. 32700

Fax: 519-746-4319

PDF files require Adobe Acrobat Reader

Thursday, September 14, 2023 11:30 AM EDT

Guilherme Macieira De Araujo | Applied Mathematics, University of Waterloo

Parallel-in-time methods for speeding up optimization algorithms

Parallel-in-time methods such as multigrid-reduction-in-time (MGRIT) and parareal utilize an iterative multilevel multigrid structure to solve linear systems of differential equations by solving a coarse-grid problem, which is less costly while also approximating the original, fine-grid problem. Such methods have been successfully applied to speeding up the solution of parabolic PDEs, while more recent developments have shown their capability in also solving some hyperbolic PDEs.

Various iterative optimization algorithms for solving unconstrained minimization problems, such as gradient descent and Nesterov accelerated gradient, take the form of one- or two-step updates. The convergence rates of these algorithms can be extremely slow and, fortuitously, solving them in parallel is equivalent to solving the same exact kind of linear systems to which MGRIT can be applied to. We also note that, for sufficiently small time steps, these algorithms can also be interpreted as discretizations of certain ODEs.

Inspired by these observations, we explore using parallel-in-time methods to parallelize discrete optimization algorithms in order to reduce the wall-clock time required to run them. In this seminar, we also briefly discuss foreseeable challenges, open questions regarding our approach and ideas to better suit these parallel-in-time methods for this application on optimization problems.

Event tags

**Contact Info**

Department of Applied Mathematics

University of Waterloo

Waterloo, Ontario

Canada N2L 3G1

Phone: 519-888-4567, ext. 32700

Fax: 519-746-4319

PDF files require Adobe Acrobat Reader

University of Waterloo

University of Waterloo

43.471468

-80.544205

200 University Avenue West

Waterloo,
ON,
Canada
N2L 3G1

The University of Waterloo acknowledges that much of our work takes place on the traditional territory of the Neutral, Anishinaabeg and Haudenosaunee peoples. Our main campus is situated on the Haldimand Tract, the land granted to the Six Nations that includes six miles on each side of the Grand River. Our active work toward reconciliation takes place across our campuses through research, learning, teaching, and community building, and is co-ordinated within the Office of Indigenous Relations.