CompMath & CO Joint Seminar - Andreas GriewankExport this event to calendar

Thursday, December 5, 2019 — 9:30 AM EST

Title: How can we optimize nonsmooth objectives globally?

Speaker: Andreas Griewank
Affiliation: Humboldt University, Germany
Room: MC 5501

Abstract:

In machine learning objective functions that are only piecewise smooth and should be globally minimized abound. The standard method of dealing with them is to apply a stochastic gradient method disregarding the rare points of nonsmoothness and hoping for the best as far as global optimality of the computed solution is concerned. Without doubting that this optimistic approach often works very well in practice, we explore the possibility of successively abs-linearizing such functions and solving the resulting local model problems in one of three ways. Firstly Coordinate Global Descent (see S. Wright), a Savvy variant of the Heavy Ball method proposed by B.T. Polyak and the solution of an equivalent Mixed Integer Bilinear Optimization Problem by modern solvers like Gurobi. We present numerical results from simple regression tasks and the inevitable MNIST problem. Joint work with Angel Rojas.

Location 
MC - Mathematics & Computer Building
5501
200 University Avenue West

Waterloo, ON N2L 3G1
Canada

S M T W T F S
29
30
31
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
1
  1. 2020 (11)
    1. January (11)
  2. 2019 (167)
    1. December (5)
    2. November (15)
    3. October (18)
    4. September (15)
    5. August (9)
    6. July (17)
    7. June (18)
    8. May (16)
    9. April (9)
    10. March (24)
    11. February (13)
    12. January (8)
  3. 2018 (138)
  4. 2017 (103)
  5. 2016 (137)
  6. 2015 (136)
  7. 2014 (88)
  8. 2013 (48)
  9. 2012 (39)
  10. 2011 (36)
  11. 2010 (40)
  12. 2009 (40)
  13. 2008 (39)
  14. 2007 (15)