| Entrambe le parti precedenti la revisione
Revisione precedente
Prossima revisione
|
Revisione precedente
Prossima revisione
Entrambe le parti successive la revisione
|
mds:lbi:start [26/11/2021 alle 08:33 (2 anni fa)]
Anna Monreale [Class calendar - (2021-2022)] |
mds:lbi:start [25/02/2023 alle 20:13 (14 mesi fa)]
Anna Monreale [Class calendar - (2022-2023)] |
| | |
| ga('personalTracker.require', 'displayfeatures'); | ga('personalTracker.require', 'displayfeatures'); |
| ga('personalTracker.send', 'pageview', 'ruggieri/teaching/lbi/'); | ga('personalTracker.send', 'pageview', 'courses/lds/'); |
| setTimeout("ga('send','event','adjusted bounce rate','30 seconds')",30000); | setTimeout("ga('send','event','adjusted bounce rate','30 seconds')",30000); |
| </script> | </script> |
| jQuery('a[href$=".pdf"]').click(function() { | jQuery('a[href$=".pdf"]').click(function() { |
| var fname = this.href.split('/').pop(); | var fname = this.href.split('/').pop(); |
| ga('personalTracker.send', 'event', 'PDS', 'PDFs', fname); | ga('personalTracker.send', 'event', 'LDS', 'PDFs', fname); |
| }); | }); |
| jQuery('a[href$=".r"]').click(function() { | jQuery('a[href$=".r"]').click(function() { |
| var fname = this.href.split('/').pop(); | var fname = this.href.split('/').pop(); |
| ga('personalTracker.send', 'event', 'LBI', 'Rs', fname); | ga('personalTracker.send', 'event', 'LDS', 'Rs', fname); |
| }); | }); |
| jQuery('a[href$=".zip"]').click(function() { | jQuery('a[href$=".zip"]').click(function() { |
| var fname = this.href.split('/').pop(); | var fname = this.href.split('/').pop(); |
| ga('personalTracker.send', 'event', 'LBI', 'ZIPs', fname); | ga('personalTracker.send', 'event', 'LDS', 'ZIPs', fname); |
| }); | }); |
| jQuery('a[href$=".mp4"]').click(function() { | jQuery('a[href$=".mp4"]').click(function() { |
| var fname = this.href.split('/').pop(); | var fname = this.href.split('/').pop(); |
| ga('personalTracker.send', 'event', 'LBI', 'Videos', fname); | ga('personalTracker.send', 'event', 'LDS', 'Videos', fname); |
| }); | }); |
| jQuery('a[href$=".flv"]').click(function() { | jQuery('a[href$=".flv"]').click(function() { |
| var fname = this.href.split('/').pop(); | var fname = this.href.split('/').pop(); |
| ga('personalTracker.send', 'event', 'LBI', 'Videos', fname); | ga('personalTracker.send', 'event', 'LDS', 'Videos', fname); |
| }); | }); |
| }); | }); |
| </script> | </script> |
| </html> | </html> |
| ====== LABORATORY OF DATA SCIENCE (2021/2022) ====== | ====== Decision Support Systems - Module II (6 ECTS): LABORATORY OF DATA SCIENCE (2022/2023) ====== |
| | This is the second module of [[mds:dss:start|Decision Support Systems]] (801AA, 12 ECTS), previously called Laboratory of Data Science ((664AA, 6 ECTS). |
| | |
| |
| **Instructors**: | **Instructors**: |
| * [[http://pages.di.unipi.it/amonreale/]] | * [[http://pages.di.unipi.it/amonreale/]] |
| * [[anna.monreale@unipi.it]] | * [[anna.monreale@unipi.it]] |
| * Office hours: Wednesday: 11:00-13:00 online using Teams (Appointment by email). | * Office hours: Tuesday: 11:00-13:00 by online using Teams or at the Department of Computer Science, room 374/E (Please ask an appointment by email). |
| * Telephone +39-050-2213119 | * Telephone +39-050-2213119 |
| |
| * Telephone +39-050-2212728 | * Telephone +39-050-2212728 |
| ====== News ===== | ====== News ===== |
| * [16-11-2021]: Instructions for the SSAS project in the Lecture of today: to avoid conflicts in deployment/process follow this steps once the solution is opened: (1) rename the project as <your account>_foodmart (2) from project properties select 'Deployment', then rename the database as <your account>_foodmart; (3) click on the button "show all files" just above "Solution explorer" right click on "view code" on the .database file that is visualized, and then change the ID from ruggieri_foodmart into <your account>_foodmart, and finally save the file; (4) change the credentials of connection to database on SQL Server. As an alternative solution you may[[ http://technet.microsoft.com/en-us/library/ms175630.aspx#bkmk_newusingwizard|import the project]] from the SSAS server and rename it as <your account>_foodmart (step 4 is still necessary). | * [08.11.2022] Instructions for the SSAS project in the Lecture of today: to avoid conflicts in deployment/process follow this steps once the solution is opened: (1) rename the project as <your account>_foodmart (2) from project properties select 'Deployment', then rename the database as <your account>_foodmart; (3) click on the button "show all files" just above "Solution explorer" right click on "view code" on the .database file that is visualized, and then change the ID from current name into <your account>_foodmart, and finally save the file; (4) change the credentials of connection to database on SQL Server. As an alternative solution you may[[ http://technet.microsoft.com/en-us/library/ms175630.aspx#bkmk_newusingwizard|import the project]] from the SSAS server and rename it as <your account>_foodmart (step 4 is still necessary). |
| * [15/10/2021] Instructions for installing Data Tools for Visual Studio 2019 are in the software section of the wiki. Please follow them closely, step by step. | * [09.09.2022] The lectures will be only in presence and will **NOT** be live-streamed, but recordings of the lecture or of the previous years will be made available here for non-attending students. |
| * [15/10/2021] **IMPORTANT** The first part of the project is available. Checkpoint: 15 November. | |
| * [02/10/2021] **The lecture of Monday 4th October will be canceled.** | |
| * [08/09/2021] The first lecture will be on 16 Sept. | |
| * [08/09/2021] You can join the class by using this link: https://teams.microsoft.com/l/team/19%3amm3HFMqMSvpUrGY2sMYlpzxQ-atdxhfXreRUHhvrODs1%40thread.tacv2/conversations?groupId=c196ac40-93a2-4436-adfe-a81af3d06eef&tenantId=c7456b31-a220-47f5-be52-473828670aa1 | |
| * [16/09/2021] **IMPORTANT** Please, fill the document at the following link with your information, so that we can provide you access to teaching database and mailing list: https://docs.google.com/spreadsheets/d/1yYzHXmykhbfwy7G9uB_Z1fGcW_Vtvjugy4Yvlj-aM2Y/edit?usp=sharing | |
| ====== Hours and Rooms ====== | ====== Hours and Rooms ====== |
| |
| **Classes ** | **Classes ** |
| |
| Lessons will be held onilne by Teams Platform | |
| |
| ^ Day of Week ^ Hour ^ Room ^ | ^ Day of Week ^ Hour ^ Room ^ |
| | Monday | 11:00 - 12:45 | Teams | | | Tuesday | 14:00 - 16:00 | Room Lab. H | |
| | Thursday | 09:00 - 10:45 | Teams | | | Thursday | 09:00 - 11:00 | Room Lab. M | |
| |
| **Link to Teams module:** https://teams.microsoft.com/l/team/19%3amm3HFMqMSvpUrGY2sMYlpzxQ-atdxhfXreRUHhvrODs1%40thread.tacv2/conversations?groupId=c196ac40-93a2-4436-adfe-a81af3d06eef&tenantId=c7456b31-a220-47f5-be52-473828670aa1 | A **[[https://teams.microsoft.com/l/channel/19%3a1ade445a235343fcb93aa6a19a174a5c%40thread.tacv2/Module%2520II%2520-%2520Laboratory%2520of%2520Data%2520Science?groupId=279299f3-aa07-48b1-8ec6-b2fd1a6d125d&tenantId=c7456b31-a220-47f5-be52-473828670aa1|Teams Channel]]** will be used ONLY to post news, Q&A, and other stuff related to the course. The lectures will be only in presence and will **NOT** be live-streamed, but recordings of the lecture or of the previous years will be made available here for non-attending students. |
| ====== Learning Material ====== | ====== Learning Material ====== |
| |
| ===== Slides & Registration of the classes ===== | ===== Slides & Recordings of the classes ===== |
| |
| * The slides used in the course will be inserted in the calendar after each class. | * The slides used in the course will be inserted in the calendar after each class. |
| * Registration of each lecture will be available on Teams | * Recordings of each lecture will be made available for non-attending students. |
| | |
| ===== Past Exams ===== | ===== Past Exams ===== |
| |
| |
| * Anaconda with Python 3.7 (Please, avoid Python 3.8) | * Anaconda with Python 3.7 (Please, avoid Python 3.8) |
| * SQL Server 2019 Developer Edition:[[https://docs.microsoft.com/it-it/sql/ssms/download-sql-server-management-studio-ssms?view=sql-server-ver15|SQL Server 2019 Management Studio]]. | * SQL Server 2019 Developer Edition:[[https://docs.microsoft.com/en-us/sql/ssms/download-sql-server-management-studio-ssms?view=sql-server-ver16|SQL Server 2019 Management Studio]]. |
| * Data Tools for Visual Studio 2019: instructions here Italian: [[https://docs.microsoft.com/it-it/sql/ssdt/download-sql-server-data-tools-ssdt?view=sql-server-ver15#ssdt-for-visual-studio-2019|Data Tools Visual Studio 2019 IT]] English: [[https://docs.microsoft.com/en-us/sql/ssdt/download-sql-server-data-tools-ssdt?view=sql-server-ver15#ssdt-for-visual-studio-2019|Data Tools Visual Studio 2019 EN]] | * Data Tools for Visual Studio 2019: instructions here Italian: [[https://docs.microsoft.com/it-it/sql/ssdt/download-sql-server-data-tools-ssdt?view=sql-server-ver15#ssdt-for-visual-studio-2019|Data Tools Visual Studio 2019 IT]] English: [[https://docs.microsoft.com/en-us/sql/ssdt/download-sql-server-data-tools-ssdt?view=sql-server-ver15#ssdt-for-visual-studio-2019|Data Tools Visual Studio 2019 EN]] |
| * Microsoft Excel | * Microsoft Excel |
| * [[https://start.unipi.it/help-ict/vpn/ | Unipi VPN ]] | * [[https://start.unipi.it/help-ict/vpn/ | Unipi VPN ]] |
| * [[https://autenticazione.unipi.it/auth/auth.signin | Unipi Authentication]] to access the VPN, make sure that network access services are enabled on you profile. Follow this link to access your Unipi profile. | * [[https://autenticazione.unipi.it/auth/auth.signin | Unipi Authentication]] to access the VPN, make sure that network access services are enabled on you profile. Follow this link to access your Unipi profile. |
| ====== Class calendar - (2021-2022) ====== | ====== Class calendar - (2022-2023) ====== |
| ^ ^ Day ^ Topic ^ Slides ^ Data/Software ^ References ^ Video Lectures ^ Teacher | | ^ ^ Day ^ Topic ^ Slides ^ Data/Software ^ References ^ Video Lectures ^ Teacher| |
| | | 13.09 11:00-12:45| Lecture canceled | | | | | | |1. |15.09 09:00-11:00| Introduction to the Course. BI Architecture. File data access. | {{ :mds:lbi:2022-lds.01.introduction.pdf | Course Introduction}} {{ :mds:lbi:2022-lds.02.bi_architectures.pdf | BI Archit.}} {{ :mds:lbi:2022-lds.03.file_data_access.pdf | File Data Access}}| |-** BI technology:** [[https://cacm.acm.org/magazines/2011/8/114953-an-overview-of-business-intelligence-technology/fulltext | An Overview of Business Intelligence Technology]] - **File access:** {{ :mds:lbi:filesystem.pdf | File System Interface}} | [[https://unipiit.sharepoint.com/:v:/s/a__td_57058/ETP3AXvvKmNAs6wO2gdSwBQBnnIdm9e7CIiW1ao6sv68xA?e=XmsAGP|Video 1: BI Architecture]] [[https://unipiit.sharepoint.com/:v:/s/a__td_57058/EQGOCKbyor5Jv6BtfFbRX6ABA9Mit-4ARPhB_M6cD-SCZg?e=WAC02j|Video 2: File Data Access - Part 1]] | Monreale | |
| |1. | 16.09 09:00-10:45| Introduction. File data access. | {{ :mds:lbi:2021-lds.01.introduction.pdf |}} {{ :mds:lbi:2020-lds.02.bi_architectures.pptx.pdf |}} {{ :mds:lbi:2020-lds.03.file_data_access.pptx.pdf |}}| | -** BI technology:** [[https://cacm.acm.org/magazines/2011/8/114953-an-overview-of-business-intelligence-technology/fulltext | An Overview of Business Intelligence Technology]] - **File access:** {{ :mds:lbi:filesystem.pdf | File System Interface}} |[[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lecture-20210916_091511-Meeting%20Recording.mp4?web=1|Video1]] [[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lecture-20210916_102822-Meeting%20Recording.mp4?web=1|Video2]] | Monreale | | |2. | 20.09 14:00-16:00| Representation formats: CSV, FLV, ARFF, XML. Python Recap.| {{ :mds:lbi:2020-lds.04.python.pptx.pdf | Python Recap}} | | - **File Formats:** [[http://www.stat.auckland.ac.nz/~paul/ItDT | Introduction to data technologies(Chps. 5, 6)]], [[http://weka.wikispaces.com/ARFF+(stable+version)|Weka ARFF Format]], [[http://weka.wikispaces.com/XRFF|XRFF Format]] - **Python reference:** [[https://www.spronck.net/pythonbook/ | Free python book with exercises]] | [[https://unipiit.sharepoint.com/:v:/s/a__td_57058/EVudIciqB_JCpbeL0bxLbjIBMzWvDJllrSYQUqe2QdeCSA?e=4QgNVC|Video 1: File Data Access and Python Recap]] [[https://unipiit.sharepoint.com/:v:/s/a__td_57058/EaMXyY3JHGNIg7vX4FW9hkQBhOvezPLTdmp3NyO87m46wg?e=ba9YdF|Video 2: Python Recap]]| Monreale, Pellungrini | |
| |2. | 20.09 11:00-12:45| Representation formats: CSV, FLV, ARFF, XML. Python Recap | {{ :mds:lbi:2020-lds.04.python.pptx.pdf |}}| | - **File Formats:** [[http://www.stat.auckland.ac.nz/~paul/ItDT | Introduction to data technologies(Chps. 5, 6)]], [[http://weka.wikispaces.com/ARFF+(stable+version)|Weka ARFF Format]], [[http://weka.wikispaces.com/XRFF|XRFF Format]] - **Python reference:** [[https://www.spronck.net/pythonbook/ | Free python book with exercises]] |[[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lecture-20210920_110330-Registrazione%20della%20riunione.mp4?web=1|Video1]] [[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lecture-20210920_121602-Registrazione%20della%20riunione%201.mp4?web=1|Video2]] | Pellungrini | | |3. | 22.09 09:00-11:00 | File Access in Python | {{ :mds:lbi:lds.05.fileaccess-python2021.pdf |}} | {{ :mds:lbi:data1.zip |}} {{ :mds:lbi:python_solutions.zip |}}| |[[https://unipiit.sharepoint.com/:v:/s/a__td_57058/EbciASaZjItFqNtjSCpAohcBBeqLaMbSWE3iZ0XP9RM_UA?e=YB8xfj|Video: Python Lab: Exercises & File Access]] |Pellungrini | |
| |3. | 23.09 11:00-12:45 | File Access in Python | {{ :mds:lbi:lds.05.fileaccess-python2021.pdf |}} | {{ :mds:lbi:census.csv.zip |}} {{ :mds:lbi:data1.zip |Collection of files}} {{ :mds:lbi:solutionspart1.zip | Partial Solutions to Python Exercises}} | | [[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lectures-20210923_090410-Registrazione%20della%20riunione.mp4?web=1|Video1]] [[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lectures-20210923_103339-Registrazione%20della%20riunione.mp4?web=1|Video2]]| Pellungrini | | |4. | 26.09 14:00-16:00 | File Access in Python, lab practice | {{ :mds:lbi:lds.05.fileaccess-python2021.pdf |}} | {{ :mds:lbi:data1.zip |}}{{ :mds:lbi:solutions26092022.zip |}} | | [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/EeFtvS3FifpHpMBcLqTR838BLcXdy53knxEQS2aNYo5v3w?e=qpZSix|Video Lecture]]|Pellungrini | |
| |4. | 27.09 9:00-10:45 | File Access in Python Practice | {{ :mds:lbi:lds.05.fileaccess-python2021.pdf |}} | {{ :mds:lbi:census.csv.zip |}} {{ :mds:lbi:data1.zip |Collection of files}} {{ :mds:lbi:solutionspart1.zip | Partial Solutions to Python Exercises}} {{ :mds:lbi:csv2arrf.py.zip | csv to Arff conversion solution}}| | [[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/Riunione%20in%20_General_-20210927_113233-Registrazione%20della%20riunione.mp4?web=1|Video]] | Pellungrini | | |5. | 29.09 9:00-11:00 | Python Exercises | {{ :mds:lbi:ex-customers.pdf |}} | {{ :mds:lbi:data-customers.zip |}} {{ :mds:lbi:ex-customers_solution.zip |}} {{ :mds:lbi:lds.file.format.zip |}}| | [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/EY2gMgaN5phBq-CFpyJIQ9UBrdHTrFY5FR7H7s3RDMU1Tg?e=owdZAX|Video Lecture]] |Pellungrini| |
| |5. | 30.09 9:00-10:45 | Python Exercises | {{ :mds:lbi:ex-customers.pdf |}} | {{ :mds:lbi:ex-customers_solution.zip |}} {{ :mds:lbi:data-customers.zip |}} {{ :mds:lbi:lds.file.format.zip |}}| | [[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lectures-20210930_090341-Registrazione%20della%20riunione.mp4?web=1|Video1]] [[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lectures-20210930_095844-Registrazione%20della%20riunione.mp4?web=1|Video2]] [[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lectures-20210930_103921-Registrazione%20della%20riunione.mp4?web=1|Video3]] |Pellungrini| | |6. | 04.10 14:00-16:00 |RDBMS access protocols: ODBC, OLE DB, JDBC. ODBC Programming. | {{ :mds:lbi:lds.06.relational_data_access-2021.pdf |}} | | | [[https://unipiit.sharepoint.com/:v:/s/a__td_57058/ETwH7giy9a9Mi7Xtfu9OuX0BBxaBF-esaYndY_Ah2ZdXXA?e=kD1zTn|Video 1]]; [[https://unipiit.sharepoint.com/:u:/s/a__td_57058/EZqPbMAVuXdFn6_1GWVG8dABalyJM5kEPNAoSD2dzz7Ogw?e=rFcn6n|Video 2]] | Monreale| |
| | | 04.10 11:00-12:45 | Lecture canceled | | | | | | |7. | 06.10 09:00-11:00 |RDBMS access protocols: ODBC, OLE DB, JDBC. ODBC Programming. | {{ :mds:lbi:lds.06.relational_data_access-2021.pdf |}} | {{ :mds:lbi:2021-code-db-samples.zip |}}| | | Monreale| |
| |6. | 07.10 9:00-10:45 |RDBMS access protocols: ODBC, OLE DB, JDBC. ODBC Programming. | {{ :mds:lbi:lds.06.relational_data_access-2021.pdf |}} | | | | Monreale| | |8. | 11.10 14:00-16:00 | Stratified Sampling, SQL server management demo | {{ :mds:lbi:lds.07.sqlserver.pdf |}} | {{ :mds:lbi:stratifiedsampling.zip |}}| |[[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/EYsfdMxeMdJLq7aKa6ChyJQBP1X6-HWRKgI8eNyj7ECycw?e=3f8fI5|Video Lecture]] | Pellungrini| |
| |7. | 11.10 11:00-12:45 |RDBMS access protocols: ODBC, OLE DB, JDBC. ODBC Programming. | {{ :mds:lbi:lds.06.relational_data_access-2021.pdf |}} | {{ :mds:lbi:2021-code-db-samples.zip |}}| | | Monreale| | |9. | 13.10 09:00-11:00 |ETL tools: SQL Server Integration Services (SSIS). | {{ :mds:lbi:lds.08.etlandssis.pdf |}}| | | [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/ETXouaErlVtPunby2a03fOMBoZFdxbzdNdTgqsE1G1dAWQ?e=DRDruP|Video1]][[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/EYp2NAEPOPpEhLrwLXXGMWEBmw11n5jHVxk3W_cq9hKkRw |
| |8. | 14.10 9:00-10:45 |Stratified sampling | {{ :mds:lbi:lds.07.sqlserver.pdf |}} | {{ :mds:lbi:stratifiedsampling.zip |}}| |[[https://unipiit.sharepoint.com/:v:/r/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lectures-20211014_090430-Registrazione%20della%20riunione.mp4?csf=1&web=1&e=XxhSv7|Video]] | Pellungrini| | |Video 2]] [[https://unipiit.sharepoint.com/:v:/s/a__td_524292/Eag-ig3Gsr9IltX0UiIx2OMBzzt8Jls0IBdVrNRxjPQnHw?e=jHZYf4|Video 1 - 2021]]| Monreale| |
| |9. | 18.10 12:00-12:45 | ETL Introduction | {{ :mds:lbi:lds.08.etlandssis.pdf |}} | | |[[https://unipiit.sharepoint.com/:v:/r/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lecture-20211018_121039-Registrazione%20della%20riunione.mp4?csf=1&web=1&e=Nq6CMT|Video]] | Monreale| | |10. | 18.10 14:00-16:00 |ETL tools: explanation + practice | {{ :mds:lbi:lds.08.etlandssis.pdf |}}| {{ :mds:lbi:2021-lds-etl-project.zip |}} | | [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/ETqRob0alitAv7t0HbEXPvoB7pqUhKWTPtPySF0y3cTyOA?e=kXWdPQ|Video]]| Pellungrini| |
| |10. | 21.10 9:00-10:45 | SSIS: toCSV, FromCSV | | {{ :mds:lbi:2021-lds-etl-project.zip |}} | | [[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lectures-20211021_091055-Regi{{ :mds:lbi:foodmart_monreale_full.zip |}}strazione%20della%20riunione.mp4|Video]]| Monreale | | |11. | 20.10 09:00-11:00 |SSIS exercises: Stratified Subsampling | {{ :mds:lbi:ex-midterm.pdf |}} | | | [[https://unipiit.sharepoint.com/:v:/s/a__td_524292/EStEjTSwWmpPs8OUhgn87eoBYqfq18tJURoIazSn1XBsIA?e=J9os3H|Video of the last year]]| Monreale| |
| |11. | 25.10 11:00-12:45 |SSIS exercises: Pipeline, Update | {{ :mds:lbi:exercisefact_table.pdf |}} | | | [[https://unipiit.sharepoint.com/sites/a__td_524292/Shared%20Documents/General/Recordings/LDS%20Lecture-20211025_110645-Registrazione%20della%20riunione.mp4|Video]]| Monreale | | |12. | 25.10 14:00-16:00 |SSIS exercises: Dissimilarity Index + project support | {{ :mds:lbi:ex-midterm.pdf |}} | {{ :mds:lbi:exercises25102022.zip |}} | | [[ https://unipiit.sharepoint.com/:v:/s/Registrazioni628/ETsCALQT3RpFroh_ejSiDlABtV8erMLv1nci_Bv4QmCDiw?e=8jzYli |Video]]| Pellungrini| |
| |12. | 28.10 9:00-10:45 | SSIS exercises: Stratified Subsampling | {{ :mds:lbi:ex-midterm.pdf |}} | | | | Monreale | | |13. | 27.10 09:00-11:00 |Slowly Changing Dimensions + project support | | {{ :mds:lbi:lbiexamplescomplete.zip |}} | | [[ https://unipiit.sharepoint.com/:v:/s/Registrazioni628/ERDloA16n-lOtev3zK9nNRwBxnGwpoy2qg-8GVhU-nP2sw?e=PDKeay |Video]]| Pellungrini| |
| |13. | 04.11 9:00-10:45 | Project Support & Discussion | | | | | Monreale | | |14. | 03.11 09:00-11:00 |SSIS: Surrogate keys| | {{ :mds:lbi:lbiexamplescomplete.zip |}} | | [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/Ebld1Nylwo1Jtfwlovu0nSoBsECotn3m6cpwdJrkS61r5A?e=CeaE6Q |Video1]]| Monreale| |
| |14. | 08.11 11:00-12:45 | SSIS: Surrogate keys + Slowly changing dimensions | | | | | Monreale | | |15. | 08.11 14:00-16:00 |OLAP with SQL Server Analysis Services (SSAS): data source views, dimensions, hierarchies. |{{ :mds:lbi:lds.09.ssas-21.pdf |}} | {{ :mds:lbi:foodmart_monreale_full_2022_nov08.zip |}}|**1) SSAS (olap):** [[http://msdn.microsoft.com/en-us/library/bb522607.aspx|documentation]]; 2) S. Harinath et al. {{ :mds:lbi:ssas2012ch456.pdf |Professional Microsoft SQL Server Analysis Services 2012 with MDX and DAX, Wrox publisher, 2012. Chps. 4-6}} | [[https://unipiit.sharepoint.com/:v:/s/a__td_57058/EUX2ObQqufBDrkx7yFcHqDEB4Zr_LUdRREIN6vxuAYpDFA?e=ykDFgl|Video]] We published the recording of the last year because the video has some audio issue.| Pellungrini| |
| |15. | 11.11 9:00-10:45 | SSIS: Slowly changing dimensions + Datawarehousing and OLAP recap. | {{ :mds:lbi:lds.09.dwandolap.pdf |}} | {{ :mds:lbi:2021-lds-etl-project_full.zip |}} | | | Monreale | | |16. | 10.11 09:00-11:00 |OLAP with SQL Server Analysis Services (SSAS): Data cubes, Parent-child hierarchies. | same slides of the last lecture | | This version of the project contains the dependecies {{ :mds:lbi:10nov-foodmart_monreale_full.zip |}} | [[https://unipiit.sharepoint.com/:v:/s/a__td_57058/ESA7pAfGhdtPnwgoD4i9p4QB3D-PRfOfDS7sTKurHKYQ_Q?e=vhTpYx|Video]]| Monreale| |
| |16. | 15.11 11:00-12:45 | OLAP with SQL Server Analysis Services (SSAS): data source views, dimensions, hierarchies. Data cubes, Parent-child hierarchies. | {{ :mds:lbi:lds.09.ssas-21.pdf |}} | {{ :mds:lbi:foodmart_monreale_full-cube.zip |}} | | | Monreale | | |17. | 15.11 14:00-16:00 |OLAP Cube, Measure setup, Calculated Members, Excel power pivot integration.| same slides of the last lecture |{{ :mds:lbi:foodmartexplorative.xlsx |}} | | [[ https://unipiit.sharepoint.com/:v:/s/Registrazioni628/EUsRIkohIKdMqt4jbGTdxtwBbVabSQPbW9tpjHmBruSyCQ?e=y1UehI |Video 1]]; [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/EesjYirvg2JKsUD1pAYHBxwBSqQCI1LGJXDtBxxLi5Dc6w?e=4W1uOr|Video 2]] | Monreale| |
| |17. | 18.11 11:00-12:45 | Cube deployment. Measure setup, Calculated Members, Excel power pivot integration. ROLAP, MOLAP, HOLAP definition and setup. Cache management.| | {{ :mds:lbi:foodmartexplorative.xlsx |}} {{ :mds:lbi:foodmart_monreale_complete.zip |}}| | | Monreale | | |18. | 17.11 9:00-11:00 | Visual Studio advanced Features and MDX first examples| same slides of the last lecture | {{ :mds:lbi:foodmart_monreale_full.zip |}} | **MDX:** 1) [[http://msdn.microsoft.com/en-us/library/bb500184.aspx|documentation]] and a [[https://www.mssqltips.com/sqlservertip/3129/order-and-sort-with-mdx-in-sql-server-analysis-services/|useful guide on ordering]]; 2) S. Harinath ed al. {{ :mds:lbi:ssas2012ch3.pdf |Professional Microsoft SQL Server Analysis Services 2012 with MDX and DAX, Wrox publisher, 2012. Chp. 3.}} | [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/EQ3lRlKIyatJuMi2tlOH6LUBbrk8uslzqZylLFFr6QzjCQ?e=mlUdsa|Video ]]| Pellungrini| |
| |18. | 22.11 11:00-12:45 | Introduction to MDX | | {{ :mds:lbi:2021-mdxquery-demo-partial.mdx.zip |}}| Since the video of this lecture has some issue I'm linking the Video of the last year. It is not exactly equal but very similar. The videos are two because the lectures of these year could not be completely aligned. [[https://web.microsoftstream.com/video/691fe567-b0f9-4994-8ec8-1b4dc5a3d9c4 | Video1]] [[https://web.microsoftstream.com/video/f1392414-f329-4769-9475-cb3457dbd712|Video2]]| Monreale | | |19. | 22.11 14:00-16:00 | MDX Practice| same slides of the last lecture | | | [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/EVWsnC85_edHorLhH9Gz9DsBcXF1nvxaexdGPmV2SqHYTg?e=MgoBeB|Video ]]| Monreale| |
| |19. | 25.11 09:00-11:00 | Practice on MDX | | {{ :mds:lbi:2021-mdxquery-demo.mdx.zip |}} | | Monreale| | |20. | 24.11 09:00-11:00 | MDX Practice| same slides of the last lecture | {{ :mds:lbi:mdx-practice.zip |}} | | [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/EVWsnC85_edHorLhH9Gz9DsBcXF1nvxaexdGPmV2SqHYTg?e=MgoBeB|Video ]]| Monreale| |
| | |21. | 29.11 14:00-16:00 | MDX Practice| same slides of the last lecture | {{ :mds:lbi:practice2.zip |}} | | [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/EfJYhhK_DsRBuCnhbmR5ZiMBDNmlZ_UehyXWuk8wFJRsnQ?e=eLYHPJ|Video ]]| Monreale| |
| | |22. | 01.12 09:00-11:00 | Practice on MDX + PowerBI| {{ :mds:lbi:lds.12.powerbi.pdf |}} | {{ :mds:lbi:mdxqueryies.zip |}}| | [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/Ec0UO5Oy7gVEs0eHCaALkTEBwZReeBuejKEHJDyydR-pWw?e=3JMrCh|Video ]]| Monreale| |
| | |23. | 13.12 14:00-16:00 | Lecture by Noovle SPA, TIM Group (lecture only in Italian)| | | | [[|Video ]]| Monreale| |
| | |24. | 15.12 09:00-11:00 | Lecture by Noovle SPA, TIM Group (lecture only in Italian)| | | | [[|Video ]]| Monreale| |
| |
| ====== Exams ====== | ====== Exams ====== |
| | //There are no mid-terms//. The exam of Decision Support Systems (801AA, 12 ECTS) consists of a written part and an oral part on the topics of the first module (50% of the final grade), and a lab project with discussion on the topics of the second module (50% of the final grade). For the rules of the first module visit the [[http://didawiki.di.unipi.it/doku.php/mds/dsd/start|Module I: Decision Support Databases]]. |
| | For details on the Lab project read with attention the next section. |
| |
| **PROJECT ** | **PROJECT ** |
| The project has to be performed by a team of 2 students (at most 3 after asking authorization for that to the teachers). | The project has to be performed by a team of 2 students (at most 3 after asking authorization for that to the teachers). |
| |
| **Project to be delivered within 31 December 2021 ** | Each part of the project **must be documented** with a brief pdf report (no more that 2/3 pages) describing your solution. |
| * First part of the project consists in the **assignments** described here: {{ :mds:lbi:lds_project_2021_part_1.pdf |}} | |
| * A note about the first part of the project: for the 'language' attribute in the geography table, you should search for the necessary information elsewhere. Some examples are: http://download.geonames.org/export/dump/countryInfo.txt and http://www.fullstacks.io/2016/07/countries-and-their-spoken-languages.html | |
| * Second part of the project consist in the **assignments** described here:{{ :mds:lbi:lds_project_2021_part_2.pdf |}} | |
| * Third part of the project consist in the **assignments** described here: | |
| * Remember to re-submit all three parts of the project with your third part, as specified in the document above. | |
| * **Dataset:** {{ :mds:lbi:data2021.zip |}} | |
| * **Deadline**: First deadline - <del>15 Nov 2021</del> 22 Nov 2021 | |
| |
| | **Project to be delivered within 31 December 2022 ** |
| | * First part of the project consists in the **assignments** described here:{{ :mds:lbi:lds_project_2022_part_1.pdf |}} |
| | * Second part of the project consist in the **assignments** described here:{{ :mds:lbi:lds_project_2022_part_2.pdf |}} |
| | * Third part of the project consist in the **assignments** described here: {{ :mds:lbi:lds_project_2022_part_3.pdf |}} |
| | * Remember to re-submit all three parts of the project with your third part, as specified in the document above. |
| | * **Dataset:** {{ :mds:lbi:answerdatasetnew.zip |}} |
| | * **Deadline**: First deadline - 9 Nov 2022 |
| | * **Deadline**: Second deadline - 10 Dec 2022 |
| | * **Deadline**: Third deadline - 31 Dec 2022 |
| | |
| **Project to be delivered during the exam sessions ** | **Project to be delivered during the exam sessions ** |
| Students who did not deliver the above project within 31 December 2021 need to ask by email a new project to the teachers. The project that will be assigned will require about 2 weeks of work and after the delivery it will be discussed during the oral exam. For those students, the oral exams will also cover some practical parts that could not be included in the project. | Students who did not deliver the above project within 31 December 2022 need to ask by email a new project to the teachers. The project that will be assigned will require about 2 weeks of work and after the delivery it will be discussed during the oral exam. For those students, the oral exams will also cover some practical parts that could not be included in the project. ** Please write to both teachers!** |
| |
| |
| |
| =====Past Editions ===== | =====Past Editions ===== |
| | * [[LDS 2021-2022]] |
| * [[LDS 2020-2021]] | * [[LDS 2020-2021]] |
| * [[LDS 2019-2020]] | * [[LDS 2019-2020]] |
| * [[LDS 2018-2019]] | * [[LDS 2018-2019]] |
| * [[LBI 2017-2018]] | * [[LBI 2017-2018]] |
