DB/IR Seminar - Waving the Magic WANDExport this event to calendar

Tuesday, August 5, 2014 3:00 PM EDT
Speaker: Alistair Moffat, , Department of Computing and Information Systems, The University of Melbourne
Abstract: Web search services process thousands of queries per second, and filter their answers from collections containing very large amounts of data. Fast response to queries is a critical service expectation. The well-known WAND (Weak AND) processing strategy is one way of reducing the amount of computation necessary when executing such a query. The value of WAND has now been validated in a wide range of studies, and has become one of the key baselines against which all new top-k processing algorithms are benchmarked. However, most previous implementations of WAND-based retrieval approaches have been in the context of the BM25 Okapi similarity scoring regime. Here we measure the performance of WAND in the context of the alternative Language Model similarity score computation, and find that the dramatic efficiency gains reported in previous studies are no longer achievable. That is, when the primary goal of a retrieval system is to maximize effectiveness, WAND is relatively unhelpful in terms of attaining the secondary objective of maximizing query throughput rates. However, the BlockMax-WAND algorithm does in fact help reducing the percentage of postings to be scored, but with additional computational overhead. We explore a variety of trade-offs between scoring metric and processing regime and present new insight into how score-safe algorithms interact with rank scoring.
Location 
DC - William G. Davis Computer Research Centre
Room 1304
200 University Avenue West

Waterloo, ON N2L 3G1
Canada

S M T W T F S
28
29
30
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
1
  1. 2024 (8)
    1. May (1)
    2. April (1)
    3. March (5)
    4. February (1)
  2. 2023 (13)
    1. December (2)
    2. October (1)
    3. September (2)
    4. August (2)
    5. May (3)
    6. April (1)
    7. February (1)
    8. January (1)
  3. 2022 (6)
  4. 2021 (8)
  5. 2020 (6)
  6. 2019 (27)
  7. 2018 (26)
  8. 2017 (15)
  9. 2016 (25)
  10. 2015 (19)
  11. 2014 (34)