University COVID-19 update

The University of Waterloo is constantly updating our most Frequently Asked Questions.

Questions about buildings and services? Visit the list of Modified Services.

Please note: The University of Waterloo is closed for all events until further notice.

Department seminar by Jimmy Lin, University of WaterlooExport this event to calendar

Thursday, February 11, 2016 — 2:00 PM EST

Lessons Learned From Building Big Data Systems at Twitter

I spent an extended sabbatical at Twitter from 2010-2012 working on
analytics infrastructure to support data science and services designed
to surface relevant content to users. During this time, Twitter's
Hadoop data warehouse grew from dozens of nodes to tens of thousands
of nodes across multiple datacenters, ingesting tens of terabytes
daily from dozens of heterogeneous sources. I also had the opportunity
to contribute to a variety of data products, including real-time
search and Twitter's WTF recommendation service.

In this talk, I will attempt to distill my experiences working on "big
data" systems into a series of high-level "lessons learned", and then
try to connect these lessons to academic research. I'll present a few
interesting research directions and discuss my views about the
evolving roles of academic and industrial research.

Location 
M3 - Mathematics 3
3127

,

Event tags 

S M T W T F S
25
26
27
28
29
30
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
1
2
3
4
5
  1. 2021 (51)
    1. October (1)
    2. September (2)
    3. July (1)
    4. June (2)
    5. May (6)
    6. April (8)
    7. March (13)
    8. February (7)
    9. January (12)
  2. 2020 (71)
    1. December (2)
    2. November (13)
    3. October (16)
    4. September (7)
    5. August (5)
    6. July (3)
    7. June (2)
    8. May (1)
    9. March (4)
    10. February (4)
    11. January (14)
  3. 2019 (65)
  4. 2018 (44)
  5. 2017 (55)
  6. 2016 (44)
  7. 2015 (38)
  8. 2014 (44)
  9. 2013 (46)
  10. 2012 (44)