Indice

Information Retrieval - Academic Year 2010/2011

General Information

Goals

Study, design and analysis of IR systems which are efficient and effective to process, mine, search, cluster and classify documents, coming from textual, html or XML data collections. In particular, we will:

Exam

Project assigned during the course, plus an oral discussion concerning with the project and the course material.

Date Text of the exam
01/02/2011 text
21/02/2011 text
24/06/2011 text
20/07/2011 text
01/09/2011 text

Books, notes, ...

Content of the Lectures

Date Argument Refs Speaker
20/10/2010 Introduction: large data collections and new algorithmic challanges? slides
25/10/2010 Boolean retrieval: Inverted Lists = Dictionary + Postings. Query resolution via list-intersection. Chap 1 in [MRS], and slides
28/10/2010 Index construction: BSBI, SPIMI, distributed (Map-Reduce), dynamic. Chap 4 in [MRS] and notes (drop "Snow Plow"), slides
04/11/2010 The term vocabulary: parsing, tokenization, lemmatization, stemming, Thesauri, soundex, etc.. Statistical models for texts: Zipf, Luhn. Chap 2.1, 2.2 and 5.1 in [MRS], slides
08/11/2010 Faster boolean query processing: skips and phrase queries. String search: Hash Tables, Cuckoo hashing. Chap 2.3, 2.4, and slides
11/11/2010 Min-Ordered Perfect Hash. Prefix search: Tries, 2-level indexing, Front-coding. notes and slides
15/11/2010 Tolerant retrieval. Chap 3 and 5.2 in [MRS], and slides
18/11/2010 The Bloom Filter. slides are enough
22/11/2010 IL compressed storage chaps 5 in [MRS] and slides
02/12/2010 Document storage via Huffman, its canonical variant and Huffword. LZ-compression: LZ77, LZ78, gzip. all data compression's material can be found in Chap 2 in [WMB] and slides
06/12/2010 Scoring, term weighting and the vector space model. Relevance feedback and pseudo-relevance. Query expansion. top-k retrieval chap 6, 7 and 9 in [MRS]
09/12/2010 Zone indexes. Recommendation Systems (sketch). Quality of the results: Precision, Recall, F-measure. chap 8 in [MRS] and slides
13/12/2010 Lucene in action. slides and web site Ugo Scaiella
16/12/2010 Self-evaluation at home on Lucene: a small project.
20/12/2010 Self-evaluation at home on Lucene: a small project.
10/01/2011 Web search-engines: Web features and structure, advertising (sketch), crawling, consistent hash. 19.1-19.4 in [MRS], also this note, and chap 20
13/01/2011 Web search-engines: connectivity server, doc-duplicate detection (shingling and min-hash) and link-based ranking. 19.6 and 21 in [MRS], slides
17/01/2011 Text Classification via Supervised Learning: definition and applications. Fabrizio Sebastiani
20/01/2011 Automated text categorization: the machine learning approach, the indexing step. Fabrizio Sebastiani
24/01/2011 Automated text categorization: Methods for the inductive construction of a classifier slides Fabrizio Sebastiani