University COVID-19 update

The University of Waterloo is constantly updating our most Frequently Asked Questions.

Questions about buildings and services? Visit the list of Modified Services.

Please note: The University of Waterloo is closed for all events until further notice.

Continuous Optimization Seminar Export this event to calendar

Wednesday, October 3, 2018 — 4:00 PM EDT

Title: Review of martingale theory, stochastic gradient descent, and adaptive line-line-search for stochastic optimization.

Speaker: Courtney Paquette
Affiliation: University of Waterloo
Room: MC 5479

Abstract: With the rise of large data sets, practical algorithms for machine learning often use probability and statistics. The first half of the seminar will review some background material on probability theory, providing formal definitions of conditional expectations, martingales (super martingales), and stopping times. We will conclude by stating the optional stopping theorem. In the process, we will connect each of these probabilistic quantities with concepts from (deterministic) optimization. 

In the second half of the seminar, I will introduce the stochastic gradient descent (SGD)- a simple stochastic algorithm used to solve large finite sum problems and prove its convergence. We will finish by discussing some difficulties practitioners in ML often face when implementing SGD. Lastly, time permitting, I will introduce some current research in stochastic line search. I will present the first practical line-search method for stochastic optimization, which has rigorous convergence guarantees and requires only knowable quantities for implementation.

Location 
MC - Mathematics & Computer Building
5479

,
Canada

S M T W T F S
26
27
28
29
30
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
1
2
3
4
5
6
  1. 2020 (42)
    1. June (3)
    2. May (6)
    3. March (11)
    4. February (11)
    5. January (11)
  2. 2019 (167)
    1. December (5)
    2. November (15)
    3. October (18)
    4. September (15)
    5. August (9)
    6. July (17)
    7. June (18)
    8. May (16)
    9. April (9)
    10. March (24)
    11. February (13)
    12. January (8)
  3. 2018 (138)
  4. 2017 (103)
  5. 2016 (137)
  6. 2015 (136)
  7. 2014 (88)
  8. 2013 (48)
  9. 2012 (39)
  10. 2011 (36)
  11. 2010 (40)
  12. 2009 (40)
  13. 2008 (39)
  14. 2007 (15)