Queste sono le differenze tra la revisione selezionata e la versione attuale della pagina.
Entrambe le parti precedenti la revisione Revisione precedente Prossima revisione | Revisione precedente Ultima revisione Entrambe le parti successive la revisione | ||
mds:dsd:start [14/02/2021 alle 19:15 (3 anni fa)] Salvatore Ruggieri [Classes] |
mds:dsd:start [27/03/2024 alle 13:18 (8 settimane fa)] Salvatore Ruggieri [Exams] |
||
---|---|---|---|
Linea 9: | Linea 9: | ||
ga(' | ga(' | ||
ga(' | ga(' | ||
- | ga(' | + | ga(' |
- | + | ||
ga(' | ga(' | ||
- | ga(' | + | ga(' |
setTimeout(" | setTimeout(" | ||
</ | </ | ||
<!-- End Google Analytics --> | <!-- End Google Analytics --> | ||
+ | <!-- Global site tag (gtag.js) - Google Analytics --> | ||
+ | <script async src=" | ||
+ | < | ||
+ | window.dataLayer = window.dataLayer || []; | ||
+ | function gtag(){dataLayer.push(arguments); | ||
+ | gtag(' | ||
+ | |||
+ | gtag(' | ||
+ | </ | ||
<!-- Capture clicks --> | <!-- Capture clicks --> | ||
< | < | ||
Linea 42: | Linea 51: | ||
</ | </ | ||
</ | </ | ||
- | ====== Decision Support Databases A.Y. 2020/21 ====== | + | ====== |
- | The course | + | This is the first module of [[mds: |
+ | |||
+ | The module | ||
< | < | ||
=====Instructor===== | =====Instructor===== | ||
- | * **Salvatore Ruggieri** | + | * **Salvatore Ruggieri** |
* Università di Pisa | * Università di Pisa | ||
* [[http:// | * [[http:// | ||
* [[salvatore.ruggieri@unipi.it]] | * [[salvatore.ruggieri@unipi.it]] | ||
- | * **Office hours:** Tuesdays h 14:00 - 17:00 or by appointment, | + | * **Office hours:** Tuesdays h 14:00 - 16:00 or by appointment, |
- | * **Office hours only via Skype or Teams by appointment. Skype contact: salvatore.ruggieri** | + | |
- | + | ||
- | + | ||
- | =====Classes===== | + | |
- | Lessons will be virtual using Teams ([[https:// | ||
+ | =====Hours and rooms===== | ||
^ Day of Week ^ Hour ^ Room ^ | ^ Day of Week ^ Hour ^ Room ^ | ||
- | | Wednesday | + | | Wednesday |
- | | | + | | |
+ | A [[https:// | ||
=====Mandatory teaching material ===== | =====Mandatory teaching material ===== | ||
- | * **[DW]** A. Albano, S. Ruggieri. [[http://apa.di.unipi.it/bsd/ | + | * **[DW]** A. Albano, S. Ruggieri. [[http://fondamentidibasididati.it/wp-content/ |
- | * **[DB]** A. Albano. [[http:// | + | * **[DB]** A. Albano. [[http:// |
- | * Examples of [[http:// | + | * Examples of {{ :mds: |
=====Software===== | =====Software===== | ||
- | * [[http:// | + | * [[http:// |
- | * [[https:// | + | * [[https:// |
+ | * [[https:// | ||
=====Preliminary program and calendar===== | =====Preliminary program and calendar===== | ||
- | * [[https:// | + | * [[https:// |
- | * [[https:// | + | * [[https:// |
=====Exams===== | =====Exams===== | ||
- | __//There are no mid-terms// | + | __//There are no mid-terms// |
- | Registration to exams is mandatory (**look at the deadline for registering!**): | + | Registration to the written exam is mandatory (**pay attention |
+ | |||
+ | **Please indicate in the notes "Only Lab" for doing only the discussion of the lab project; "Only DSD" for doing only the written+oral part of the DSD module; or " | ||
^ Date ^ Hour ^ Room ^ Notes ^ | ^ Date ^ Hour ^ Room ^ Notes ^ | ||
- | | | + | | |
+ | | 25/6/2024 | 9:00 - 11:00 | TBD | | | ||
+ | | 23/7/ | ||
+ | | 13/9/ | ||
< | < | ||
- | <!-- | + | <!-- [[https:// |
- | | 27/ | + | |
- | --> | + | |
</ | </ | ||
- | =====Class calendar===== | ||
- | Lessons will be virtual using Teams ([[https:// | + | =====Class calendar ===== |
- | Lessons will be mostly based on exercises and Q&A. Students __must listen and study__ the required lessons of 2019 in advance.\\ | + | |
- | Recordings | + | Lessons will be **NOT** be live-streamed, |
+ | Some of recordings and teaching material are **password protected**. Ask the teacher for credentials.\\ | ||
- | **2020-01.** //Wednesday 16 September 2020, 11-13// [[http://apa.di.unipi.it/bsd/video/ | + | To watch the recordings online, you must be connected to the [[https:// |
- | Course overview and organization.\\ | + | **2023-01.** //Wednesday 20 September 2023, 11-13// |
- | //@Home:// listen and study lessons | + | |
+ | Course overview. Need for Strategic Information. Information Systems in Organizations: | ||
- | **2020-02.** //Wednesday 23 September | + | **2023-02.** //Thursday 21 September |
- | Q&A, discussion, exercises on lessons **2019-01** | + | The data warehouse (DW) and DW architectures. What to model in a DW: Facts, measures, dimensions |
- | //@Home:// listen | + | |
- | **2020-03.** //Friday 25 September | + | **2023-03.** //Wednesday 27 September |
- | Q&A, discussion, exercises on lesson **2019-03**. {{ :mds:dsd:2020-03.odm.pdf |Exercise text}}.\\ | + | Recalls: the Object Data Model. [[http:// |
- | //@Home:// listen | + | |
- | **2020-04.** //Wednesday 30 September | + | **2023-04.** //Thursday 28 September |
- | Q&A, discussion, exercises on lessons **2019-04** | + | DW modeling. |
- | //@Home:// no assignment. | + | [[http://131.114.72.230/dsd/dsd.04.assignments.pdf|Exercises at home (University exams) for the lesson 2023-05]]. |
- | **2020-05.** //Friday 2 October 2020, 14-16// [[http:// | ||
- | Q&A, discussion, exercises on lesson | + | **2023-05.** //Wednesday 4 October 2023, 11-13// **[DW: 2.1, A.1]** |
- | //@Home:// listen and study lessons | + | |
- | **2020-06.** //Wednesday 7 October 2020, 11-13// | + | The example of a data model for Master program exams. Presentation and discussion of the Hospital case study. |
- | Q&A, discussion, exercises on lessons | + | **2023-06.** //Thursday 5 October 2023, 14-16// |
- | //@Home:// no assignment. | + | |
- | **2020-07.** //Friday 9 October 2020, 14-16// | + | Recalls: the relational model and relational algebra. Exercises. |
+ | [[http://131.114.72.230/dsd/dsd.06.assignments.pdf|Exercises at home (Assignment IV) for the lesson 2023-08]]. | ||
- | Q&A, discussion, exercises on lessons | + | **2023-07.** //Wednesday 11 October 2023, 11-13//**[DW: 2.1, 2.2, A.1, B.1]** [[http://131.114.72.230/dsd/video/ |
- | //@Home:// listen and study lessons **2019-07** and **2019-10**. | + | |
- | **2020-08.** //Wednesday 14 October 2020, 11-13// | + | More about data mart conceptual design, changing dimensions and advanced data model features. From Conceptual design to relational logical design. Star model, snowflake, and constellation. Logical schema of the Hospital case study. |
- | Q&A, discussion, exercises on lessons | + | **2023-08.** //Thursday 12 October 2023, 14-16// |
- | //@Home:// no assignment. | + | |
- | **2020-09.** //Friday 16 October 2020, 14-16// [[http://apa.di.unipi.it/bsd/video/ | + | Recalls: the relational model and relational algebra. Logical trees. [[http://131.114.72.230/dsd/dsd.08.exercises.pdf|Exercises with JRS]]. |
- | Q&A, discussion, exercises on lessons **2019-07** and **2019-10**. {{ : | ||
- | //@Home:// listen and study lesson **2019-11**. | ||
- | **2020-10.** // | + | **2023-09.** // |
- | Q&A, discussion, exercises on lesson **2019-11**. {{ : | + | Discussion of students' |
- | //@Home:// listen | + | |
- | **2020-11.** //Friday 23 October | + | **2023-10.** //Thursday 19 October |
- | Q&A, discussion, exercises on lesson **2019-09**. {{ : | + | Data Warehouse design approaches. Data mart logical design. |
- | //@Home:// listen and study lessons **2019-12** and **2019-13**. | + | |
- | **2020-12.** //Wednesday 28 October | + | **2023-11.** //**Tuesday 24 |
- | Q&A, discussion, exercises on lessons **2019-09**, | + | Slowly changing dimensions, fast changing dimensions, shared dimensions. Recursive hierarchies. Multivalued dimensions. [[http:// |
- | //@Home:// no assignment. | + | |
- | **2020-13.** //Friday 30 October 2020, 14-16// [[http://apa.di.unipi.it/bsd/video/2020-13.mp4|Recording]] | + | **2023-12.** //Thursday 2 November 2023, 14-16// |
- | Q&A, discussion, exercises | + | A DW to support Analytical CRM Analysis. Wrap up on DW design. |
- | //@Home:// listen and study lessons **2019-14** and **2019-16**. | + | |
- | **2020-14.** //Wednesday 4 November 2020, 11-13// [[http:// | ||
- | Q&A, discussion, exercises on lessons | + | **2023-13.** //**Tuesday 7 November 2023, 14-16, Room L1**// **[DW: 2.3, 2.4]** [[http://131.114.72.230/ |
- | //@Home:// no assignment. | + | |
- | **2020-15.** //Friday 6 November 2020, 14-16// [[http://apa.di.unipi.it/bsd/video/ | + | Multidimensional Cube model: OLAP Operations. The extended cube and the lattice of cuboids. Pivot tables in Excel.\\ |
+ | **Additional learning material:** G. Harvey. Excel 2013 All-in-One For Dummies, 2013. [[http://131.114.72.230/dsd/PivotTable2013BookVIIchpt2.pdf|Chp. VII-2]] and [[http://131.114.72.230/dsd/HerbalTeas.xlsx|example data for pivot table]]. | ||
- | Q&A, discussion, exercises on lessons | + | **2023-14.** //Wednesday 8 November 2023, 11-13// |
- | //@Home:// no assignment. | + | |
- | **2020-16.** //Wednesday 11 November 2020, 11-13// | + | Recalls on: DBMS, from SQL to extended relational algebra. Exercises. |
+ | [[http://131.114.72.230/dsd/dsd.14.assignments.pdf|Exercises at home for the lesson 2023-15]]. | ||
- | Q&A, discussion, exercises on lessons | + | **2023-15.** //Wednesday 15 November 2023, 11-36// |
- | //@Home:// no assignment. | + | |
- | **2020-17.** //Friday 13 November 2020, 14-16// | + | OLAP systems. Data Analysis Using SQL. Simple reports. Examples. Moderately Difficult Reports. Solutions in SQL. |
+ | [[http://131.114.72.230/dsd/dsd.15.foodmart.pdf|Foodmart datawarehouse schema]]. | ||
- | Q&A, discussion, exercises on lessons | + | **2023-16.** //Thursday 16 November 2023, 14-16// |
- | //@Home:// listen and study lessons **2019-15** and **2019-17**. | + | |
- | **2020-18.** //Wednesday 18 November 2020, 11-13// | + | Examples of variance reports. Very Difficult Reports without Analytic SQL. Example of reports with ranks. Analytic Functions with the use of partitions and running totals. Examples. |
- | Q&A, discussion, exercises on lessons | + | **2023-17.** //**Tuesday 21 November 2023, 14-16, Room L1**// **[DW: 5.5-5.6]** [[http:// |
- | //@Home:// listen and study lesson **2019-18**. | + | |
- | **2020-19.** //Friday 20 November 2020, 14-16// [[http://apa.di.unipi.it/bsd/video/ | + | Analytic Functions with the use of moving windows. Examples. Exercises on Analytic SQL. [[http://131.114.72.230/dsd/dsd.17.assignments.pdf|Exercises during the lesson and at home]] and [[http://131.114.72.230/dsd/dsd.17.solutions.txt|solutions]]. |
- | Q&A, discussion, exercises on lesson | + | **2023-18.** //Wednesday 22 November 2023, 11-13// |
- | //@Home:// listen and study lesson **2019-19**. | + | |
- | **2020-20.** //Wednesday 25 November 2020, 11-13// [[http://apa.di.unipi.it/ | + | Recalls of relational DBMS internals: Storage, Indexing and Query Evaluation. Physical operators and physical plans for projection, selection, joins and grouping. Examples. |
- | Q&A, discussion, exercises on lesson | + | **2023-19.** //Wednesday 29 November 2023, 11-13// **[DW: 6.1-6.4]** [[http:// |
- | //@Home:// listen and study lesson | + | |
- | **2020-XX.** //< | + | Data Warehouse Systems: Special-Purpose Indexes and Star Query Plan. Bitmap indexes. Join indexes. Star queries optimization and query plans. Examples. Table partitioning. |
- | This lesson is reserved for the extraordinary exam session. | + | **2023-19 bis.** //Thursday 30 November 2023, 14-16, **Room Seminari Est at the Computer Science Dept.**// **[DW: 6.5-6.8]** |
- | **2020-21.** //Wednesday 2 December 2020, 11-13// [[http://apa.di.unipi.it/bsd/video/ | + | **For attending students:** Seminar (in Italian): |
- | Q&A, discussion, exercises on lesson | + | **For non-attending students:** Data Warehousing trends: column-oriented DW, main-memory DW, Big Data framework. (see recorded |
- | //@Home:// listen and study lesson | + | |
- | **2020-22.** //Friday 4 December 2020, 14-16// [[http:// | ||
- | Q&A, discussion, exercises on lesson | + | **2023-20.** //Wednesday 6 December 2023, 11-13// **[DW: 7.1-7.7]**[[http://131.114.72.230/dsd/video/dsd20_20211119.mp4|rec20 audio-video (.mp4) past years]] |
- | //@Home:// listen and study lesson **2019-22**. | + | |
- | **2020-23.** //Wednesday 9 December 2020, 11-13// | + | The problem of materialized views selection. The lattice of views and the greedy algorithm HRU for the selection of materialized views. Examples. Other algorithms for the choice of the views to materialize with a workload and dimensional hierarchies. |
- | Q&A, discussion, exercises on written test structure. Example of [[http:// | + | **2023-21.** //Thursday 7 December |
- | //@Home:// no assignment. | + | |
- | + | ||
- | **2020-24.** //Friday 11 December | + | |
- | + | ||
- | Q&A, discussion. | + | |
- | + | ||
- | =====Class calendar of A.Y. 2019/ | + | |
- | + | ||
- | Recordings are password protected. Ask the teacher for credentials. | + | |
- | + | ||
- | + | ||
- | **2019-01.** //Wednesday 18 September 2019, 14-16// **[DW: | + | |
- | + | ||
- | Course overview. Need for Strategic Information. Information Systems in Organizations: | + | |
- | + | ||
- | + | ||
- | **2019-02.** //Friday 20 September 2019, 16-18// **[DW: 1.3-1.7]** [[http:// | + | |
- | + | ||
- | The data warehouse (DW) and DW architectures. What to model in a DW: Facts, measures, dimensions and dimensional hierarchies. Examples of data analysis. Exercises on data analysis in SQL. | + | |
- | + | ||
- | **2019-03.** //Wednesday 25 September 2019, 14-16// **[DB: 1.1, 2.1-2.5]** [[http:// | + | |
- | + | ||
- | Recalls: the Object Data Model. | + | |
- | + | ||
- | **2019-04.** //Friday 27 September 2019, 16-18// **[DW: 2.1]** [[http:// | + | |
- | + | ||
- | DW modeling. A conceptual multidimensional data model. Representation of Fact, measures, dimensions, attributes and dimensional hierarchies. Key steps in conceptual design from business questions. How to identify fact types and fact granularity and measure types. How to identify dimensions, dimensional attributes and hierarchies. Examples.\\ | + | |
- | **Slides:** [[http:// | + | |
- | + | ||
- | **2019-05.** //Wednesday 2 October 2019, 14-16// **[DW: 2.1, A.1]** [[http:// | + | |
- | + | ||
- | The example of a data model for Master program exams. Presentation and discussion of the Hospital case study. | + | |
- | + | ||
- | **2019-06.** //Friday 4 October 2019, 16-18// **[DB: 3.1-3.2]** [[http:// | + | |
- | + | ||
- | Recalls: the relational model and relational algebra. Exercises. | + | |
- | + | ||
- | **2019-07.** //Wednesday 9 October 2019, 14-16// **[DW: 2.1, | + | |
- | + | ||
- | More about data mart conceptual design, changing dimensions and advanced data model features. From Conceptual design to relational logical design. Star model, snowflake, and constellation. Logical schema of the Hospital case study. | + | |
- | + | ||
- | + | ||
- | **2019-08.** //Wednesday 16 October 2019, 14-16// **[DB: 3.2-3.3]** [[http:// | + | |
- | + | ||
- | Recalls: the relational model and relational algebra. Logical trees. Exercises. | + | |
- | + | ||
- | **2019-09.** //Friday 18 October 2019, 16-18// **[DW: 2.3,2.4]** [[http:// | + | |
- | + | ||
- | Multidimensional Cube model: OLAP Operations. The extended cube and the lattice of cuboids. Pivot tables in Excel. PowerPivot.\\ | + | |
- | **Additional learning material: | + | |
- | * G. Harvey. Excel 2013 All-in-One For Dummies, 2013. [[http:// | + | |
- | * [[https:// | + | |
- | + | ||
- | + | ||
- | **2019-10.** //Wednesday 23 October 2019, 14-16// **[DW: A.2,3.1-3.5], [DWSol: B.2]** [[http:// | + | |
- | + | ||
- | Discussion of students' | + | |
- | + | ||
- | **2019-11.** //Wednesday 30 October 2019, 14-16// | + | |
- | + | ||
- | Data mart logical design. Slowly changing dimensions, fast changing dimensions, shared dimensions. Recursive hierarchies. Multivalued dimensions. Multivalued Dimensional Attributes. | + | |
- | + | ||
- | **2019-12.** // | + | |
- | + | ||
- | Recalls on: ODM-to-Relational Mapping. A DW to support Analytical CRM Analysis. | + | |
- | + | ||
- | **2019-13.** //Wednesday 6 November 2019, 14-16// **[DB: 4.1-4.2, | + | |
- | + | ||
- | Recalls on: DBMS, from SQL to extended relational algebra. Exercises.\\ | + | |
- | **Software: | + | |
- | + | ||
- | **2019-14.** //Friday 8 November 2019, 16-18// **[DW: 5.1-5.4]** [[http:// | + | |
- | + | ||
- | OLAP systems. Data Analysis Using SQL. Simple reports. Examples. Moderately Difficult Reports. Examples of variance reports. Solutions in SQL. | + | |
- | + | ||
- | **2019-15.** //Monday 11 November 2019, 16-18, **(Recover lesson - Room C1)**// **[DB: 6.1-6.6, 6.8, 7.1-7.2]** [[http:// | + | |
- | + | ||
- | Recalls of relational DBMS internals: Storage, Indexing and Query Evaluation. Physical operators and physical plans for projection, selection, joins and grouping. Examples.\\ | + | |
- | **Software: | + | |
- | + | ||
- | **2019-16.** //Wednesday 13 November 2019, 14-16// **[DW: 5.5-5.6]** [[http:// | + | |
- | + | ||
- | Very Difficult Reports without Analytic SQL. Example of reports with ranks. Analytic Functions with the use of partitions and running totals. Examples. Analytic Functions with the use of moving windows. Examples.\\ | + | |
- | **Errata-corrige: | + | |
- | **Software: | + | |
- | |Azure Data Studio]]. | + | |
- | + | ||
- | + | ||
- | **2019-17.** //Wednesday 20 November 2019, 14-16// **[DW: 6.1-6.4]** [[http:// | + | |
- | + | ||
- | Data Warehouse Systems: Special-Purpose Indexes and Star Query Plan. Bitmap indexes. Join indexes. Star queries optimization and query plans. Examples. Table partitioning. | + | |
- | + | ||
- | **2019-18.** //Friday 22 November 2019, 16-18// **[DW: 7.1-7.7]** [[http:// | + | |
- | + | ||
- | The problem of materialized views selection. The lattice of views and the greedy algorithm HRU for the selection of materialized views. Examples. Other algorithms for the choice of the views to materialize with a workload and dimensional hierarchies. | + | |
- | + | ||
- | **2019-19.** //Monday 25 November 2019, 16-18 **(Recover lesson - Room C1**)// **[DW: 8.1-8.2, DB: 3.5.1-3.5.4]** [[http:// | + | |
Recalls of functional dependency properties and how they are used to reason about the properties of the result of a query. Properties of the group-by operator. | Recalls of functional dependency properties and how they are used to reason about the properties of the result of a query. Properties of the group-by operator. | ||
- | **2019-20.** //Friday 29 November 2019, 16-18// **[DW: 8.3-8.6]** [[http://apa.di.unipi.it/bsd/video/rec20_20191129.flv|Recording | + | **2023-22.** //**Monday 11 December 2023, 14-16, Room M1**// **[DW: 8.3-8.6]** [[http://131.114.72.230/dsd/video/dsd22_20221201.mp4|rec22 audio-video |
The problem of evaluating the group-by before the join operator. First case: Invariant grouping. Examples. Other cases: double grouping, grouping and counting. Examples with star queries. | The problem of evaluating the group-by before the join operator. First case: Invariant grouping. Examples. Other cases: double grouping, grouping and counting. Examples with star queries. | ||
- | **2019-21.** // | + | **2023-23.** // |
The problem of query rewrite to use a materialized view. Hypothesis and two approaches: With a compensation on the logical view plan, and with a transformation of logical query plan. Examples. | The problem of query rewrite to use a materialized view. Hypothesis and two approaches: With a compensation on the logical view plan, and with a transformation of logical query plan. Examples. | ||
- | **2019-22.** //Friday 6 December 2019, 16-18// **[DW: 6.5-6.8]** [[http:// | ||
- | |||
- | Data Warehousing trends: column-oriented DW, main-memory DW, Big Data framework. | ||
- | |||
- | **2019-23.** //Wednesday 11 December 2019, 14-16// | ||
- | |||
- | Examples of written exams with solutions. Q. & A.\\ | ||
- | **Slides:** [[http:// | ||
- | |||
- | **2019-24.** //Friday 13 December 2019, 16-18// | ||
- | |||
- | Examples of written exams with solutions. Q. & A. | ||
=====Previous years===== | =====Previous years===== | ||
- | * [[mds:dsd:2019|Decision Support Databases | + | * [[mds:dsd:2022|Decision Support Databases |
- | * [[mds:dsd:2018|Decision Support Databases | + | * [[mds:dsd:2021|Decision Support Databases |
+ | * [[mds: | ||