University COVID-19 update

The University of Waterloo is constantly updating our most Frequently Asked Questions.

Questions about buildings and services? Visit the list of Modified Services.

Please note: The University of Waterloo is closed for all events until further notice.

Continuous Optimization Seminar - Shenghao YangExport this event to calendar

Wednesday, December 5, 2018 — 4:00 PM EST

Title: Stochastic subgradient method converges on tame functions

Speaker: Shenghao Yang
Affiliation: University of Waterloo
Room: MC 5479

Abstract: In this talk, I will present a paper (https://arxiv.org/abs/1804.07795) on the convergence of stochastic subgradient method in a nonconvex and nonsmooth setting.Stochastic subgradient method underlies several widely used solvers including Google’s TensorFlow and the open source PyTorch library. But its convergence guarantee is largely not understood in nonconvex and nonsmooth settings. Very recently, Davis et al prove that the stochastic subgradient method produces limit points that are all first-order stationary, on locally Lipschitz functions whose graph admits a Whitney stratification - a wide class of functions that subsumes all popular deep learning architectures.

In this talk, I will go through the ideas behind their proof.

Location 
MC - Mathematics & Computer Building
5479
200 University Avenue West

Waterloo, ON N2L 3G1
Canada

S M T W T F S
30
31
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
1
2
3
  1. 2020 (89)
    1. September (11)
    2. August (11)
    3. July (17)
    4. June (11)
    5. May (6)
    6. March (11)
    7. February (11)
    8. January (11)
  2. 2019 (167)
    1. December (5)
    2. November (15)
    3. October (18)
    4. September (15)
    5. August (9)
    6. July (17)
    7. June (18)
    8. May (16)
    9. April (9)
    10. March (24)
    11. February (13)
    12. January (8)
  3. 2018 (138)
  4. 2017 (103)
  5. 2016 (137)
  6. 2015 (136)
  7. 2014 (88)
  8. 2013 (48)
  9. 2012 (39)
  10. 2011 (36)
  11. 2010 (40)
  12. 2009 (40)
  13. 2008 (39)
  14. 2007 (15)