Differenze

Queste sono le differenze tra la revisione selezionata e la versione attuale della pagina.

--- mds:lbi:start [12/12/2020 alle 19:57 (4 anni fa)] – [Class calendar - (2020-2021)] Anna Monreale
+++ mds:lbi:start [24/09/2024 alle 15:54 (22 ore fa)] (versione attuale) – [Class calendar - (2024-2025)] Anna Monreale
@@ Linea 1: / Linea 1: @@
-<html>
+====== Decision Support Systems - Module II (6 ECTS): LABORATORY OF DATA SCIENCE (2024/2025) ======
-<!-- Google Analytics -->
+This is the second module of [[mds:dss:start|Decision Support Systems]] (801AA, 12 ECTS), previously called Laboratory of Data Science (664AA, 6 ECTS).
-<script type="text/javascript" charset="utf-8">
-(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
-(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
-m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
-})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
-ga('create', 'UA-34685760-1', 'auto', 'personalTracker', {'allowLinker': true});
-ga('personalTracker.require', 'linker');
-ga('personalTracker.linker:autoLink', ['pages.di.unipi.it', 'enforce.di.unipi.it', 'didawiki.di.unipi.it'] );
-ga('personalTracker.require', 'displayfeatures');
-ga('personalTracker.send', 'pageview', 'ruggieri/teaching/lbi/');
-setTimeout("ga('send','event','adjusted bounce rate','30 seconds')",30000);
-</script>
-<!-- End Google Analytics -->
-<!-- Capture clicks -->
-<script>
-jQuery(document).ready(function(){
-  jQuery('a[href$=".pdf"]').click(function() {
-    var fname = this.href.split('/').pop();
-    ga('personalTracker.send', 'event',  'PDS', 'PDFs', fname);
-  });
-  jQuery('a[href$=".r"]').click(function() {
-    var fname = this.href.split('/').pop();
-    ga('personalTracker.send', 'event',  'LBI', 'Rs', fname);
-  });
-  jQuery('a[href$=".zip"]').click(function() {
-    var fname = this.href.split('/').pop();
-    ga('personalTracker.send', 'event',  'LBI', 'ZIPs', fname);
-  });
-  jQuery('a[href$=".mp4"]').click(function() {
-    var fname = this.href.split('/').pop();
-    ga('personalTracker.send', 'event',  'LBI', 'Videos', fname);
-  });
-  jQuery('a[href$=".flv"]').click(function() {
-    var fname = this.href.split('/').pop();
-    ga('personalTracker.send', 'event',  'LBI', 'Videos', fname);
-  });
-});
-</script>
-</html>
-====== LABORATORY OF DATA SCIENCE (2020/2021) ======
 **Instructors**:
@@ Linea 49: / Linea 8: @@
     * [[http://pages.di.unipi.it/amonreale/]]
     * [[anna.monreale@unipi.it]]
-    * Office hours: Wednesday: 11:00-13:00 online using Teams (Appointment by email).
+    * Office hours: Tuesday: 11:00-13:00 online using Teams or at the Department of Computer Science, room 374/E (Please ask for an appointment by email).
     * Telephone +39-050-2213119
-  * **Roberto Pellungrini**
+ **Cristiano Landi**
-    * KDD Laboratory, Università di Pisa
+    * KDD Laboratory, Univesità di Pisa
-    * [[roberto.pellungrini@di.unipi.it]]
+    * [[cristiano.landi@phd.unipi.it]]
-    * Office hours: Thursday 14:00-16:00, Online using Teams (Appointment by email).
+    * Office hours: Wednesday: 14:00-16:00 online using Teams or at the Department of Computer Science, room 343 (Please ask for an appointment by email).
-    * Telephone +39-050-2212728
-====== News =====
+**If you are not asking for office hours, always email both instructors and include [LDS] at the beginning of the subject line.**
-  * [10/11/2020]  Instructions for the SSAS project in the Lecture of today: to avoid conflicts in deployment/process follow this steps once the solution is opened: (1) rename the project as <your account>_foodmart (2) from project properties select 'Deployment', then rename the database as <your account>_foodmart; (3) click on the button “show all files” just above “Solution explorer” right click on “view code” on the .database file that is visualized, and then change the ID from ruggieri_foodmart into <your account>_foodmart, and finally save the file; (4) change the credentials of connection to database on SQL Server. As an alternative solution you mayimport the project from the SSAS server and rename it as <your account>_foodmart (step 4 is still necessary).
-  * [13/09/2020]: The lecture will be online. You can join the class by using this link: https://teams.microsoft.com/l/team/19%3ad3bfc8ae4ed04ea99ccd7857a43e101e%40thread.tacv2/conversations?groupId=eb724cb5-3ac7-4b8e-9280-05e191cf8477&tenantId=c7456b31-a220-47f5-be52-473828670aa1
-====== Hours and Rooms ======
-**Classes **
-Lessons will be held onilne by Teams Platform
+The following is the timetable for the whole Decision Support Systems course. The two modules span differently over the semester. The first module will take most of the lessons from September to October. The second module will take most of the lessons from November to December.
 ^  Day of Week  ^  Hour  ^  Room  ^
-| Tuesday |  11:00 - 12:45  |  Teams   |
+|  Tuesday  |  9:00 - 11:00  |  Fib C  |
-| Thursday | 11:00 - 12:45  |  Teams  |
+|  Wednesday  |  16:00 - 18:00  |  Fib H-Lab  |
+|  Thursday  |  11:00 - 13:00  |  Fib A1  |
+|  Friday  |  11:00 - 13:00  |  Fib C1  |
-**Link to Teams module:** https://teams.microsoft.com/l/team/19%3ad3bfc8ae4ed04ea99ccd7857a43e101e%40thread.tacv2/conversations?groupId=eb724cb5-3ac7-4b8e-9280-05e191cf8477&tenantId=c7456b31-a220-47f5-be52-473828670aa1
+A [[https://teams.microsoft.com/l/team/19%3AqCllWc8f7UVglFSVL_MhR4ZjaLlWkUjUvJ3ROQdLSOA1%40thread.tacv2/conversations?groupId=14d45f09-9ae8-4f9f-afd1-114348877094&tenantId=c7456b31-a220-47f5-be52-473828670aa1|Teams channel]] is used to post news, Q&A, and other stuff related to the course. The lectures will be only in presence and will **NOT** be live-streamed, but recordings of the lecture from this or the previous years will be made available for non-attending students.
 ====== Learning Material ======
-===== Slides & Registration of the classes =====
+===== Slides & Recordings of the classes =====
   * The slides used in the course will be inserted in the calendar after each class.
-  * Registration of each lecture will be available on Teams
+  * Recordings of each lecture will be made available for non-attending students.
 ===== Past Exams =====
@@ Linea 87: / Linea 42: @@
 ===== Software=====
-  * Anaconda with Python 3.7 (Please, avoid Python 3.8)
+  * Anaconda (Please avoid Python 3.12)
-  * SQL Server 2019 Developer Edition:[[https://docs.microsoft.com/it-it/sql/ssms/download-sql-server-management-studio-ssms?view=sql-server-ver15|SQL Server 2019 Management Studio]].
+  * SQL Server 2019 Developer Edition or next:[[https://docs.microsoft.com/en-us/sql/ssms/download-sql-server-management-studio-ssms?view=sql-server-ver16|SQL Server 2019 Management Studio]].
-  * For Data Tools we will publish instruction soon.
+  * Visual Studio Community 2022. Install/include SSDT workload in installation manager of visual studio: instructions here Italian: [[https://learn.microsoft.com/it-it/sql/ssdt/download-sql-server-data-tools-ssdt?view=sql-server-ver15#ssdt-for-visual-studio-2022|Data Tools Visual Studio 2022 IT]] English: [[https://learn.microsoft.com/en-us/sql/ssdt/download-sql-server-data-tools-ssdt?view=sql-server-ver15#ssdt-for-visual-studio-2022|Data Tools Visual Studio 2022 EN]].
   * Microsoft Excel
   * [[https://powerbi.microsoft.com/it-it/desktop/| Power BI Desktop]]
+**Note**: preconfigured virtual machines can be found in the [[https://teams.microsoft.com/l/team/19%3AqCllWc8f7UVglFSVL_MhR4ZjaLlWkUjUvJ3ROQdLSOA1%40thread.tacv2/conversations?groupId=14d45f09-9ae8-4f9f-afd1-114348877094&tenantId=c7456b31-a220-47f5-be52-473828670aa1|Teams channel]] for both AMD64 (Intel/AMD) and ARM (Apple Silicon) architectures.
 ===== F.A.Q. =====
   * [[http://www.sid.unipi.it/polo2/2015/03/26/connessione-alle-reti-wifi/ | Connection to wi-fi]]
   * [[http://www.sid.unipi.it/polo2/studenti/ | F.A.Q.s about the labs]]
+  * [[https://start.unipi.it/help-ict/vpn/ | Unipi VPN ]]
+  * [[https://autenticazione.unipi.it/auth/auth.signin | Unipi Authentication]] to access the VPN, make sure that network access services are enabled on your profile. Follow this link to access your Unipi profile.
+====== Class calendar - (2024-2025) ======
+^ Day  ^ Topic ^ Slides  ^ Data/Software ^ References ^ Video Lectures ^
+|18.09| Introduction to the Course. BI Architectures. File data access. | {{ :mds:lbi:2024-lds.01.introduction.pdf | Introduction}} {{ :mds:lbi:2024-lds.02.bi_architectures.pdf | BI architectures}} {{ :mds:lbi:2024-lds.03.file_data_access.pdf | Files}} | |-** BI technology:** [[https://cacm.acm.org/magazines/2011/8/114953-an-overview-of-business-intelligence-technology/fulltext | An Overview of Business Intelligence Technology]] - **File access:** {{ :mds:lbi:filesystem.pdf | File System Interface}} | [[https://unipiit.sharepoint.com/:v:/s/Registrazioni628/EZeGVNiFuYlDq_UbKCecP6gB_kZpwz9DnIPvVoFfLM2laQ?nav=eyJyZWZlcnJhbEluZm8iOnsicmVmZXJyYWxBcHAiOiJTdHJlYW1XZWJBcHAiLCJyZWZlcnJhbFZpZXciOiJTaGFyZURpYWxvZy1MaW5rIiwicmVmZXJyYWxBcHBQbGF0Zm9ybSI6IldlYiIsInJlZmVycmFsTW9kZSI6InZpZXcifX0%3D&e=aaYsXE|video]] |
+|25.09| Python Recap. + Exercises | {{ :mds:lbi:2024-lds.04.python.no.ex.sol.pdf | Python Recap (no sol)}} | {{ :mds:lbi:2024-lds.04_supplementary.code.zip | supplementary code}} | **Python reference:** [[https://www.spronck.net/pythonbook/ | Free python book + exercises]] | |
+|02.10| | | | | |
+|09.10| | | | | |
+|22.10| | | | | |
+|23.10| | | | | |
+|30.10| | | | | |
+|06.11| | | | | |
+|07.11| | | | | |
+|12.11| | | | | |
+|13.11| | | | | |
+|14.11| | | | | |
+|19.11| | | | | |
+|20.11| | | | | |
+|21.11| | | | | |
+|03.12| | | | | |
+|04.12| | | | | |
+|05.12| | | | | |
+|10.12| | | | | |
+|11.12| | | | | |
+|12.12| | | | | |
+====== Exams ======
-====== Class calendar - (2020-2021) ======
+__//There are no mid-terms//.__ The exam of Decision Support Systems (801AA, 12 ECTS) consists of a written part and an oral part on the topics of the first module (50% of the final grade), and a lab project with discussion on the topics of the second module (50% of the final grade). See [[mds:dsd:start|Module I: Decision Support Databases]] for the theory part. **The project of Module II can be discussed only after passing Module I and not later than one year since then.**
-^ ^ Day  ^ Topic ^ Slides  ^ Data/Software ^ References ^ Teacher |
-|1. |  15.09 11:00-12:45| Introduction. File data access. Representation formats: CSV, FLV, ARFF, XML| {{ :mds:lbi:2020-lds.01.introduction.pptx.pdf |}} {{ :mds:lbi:2020-lds.02.bi_architectures.pptx.pdf |}} {{ :mds:lbi:2020-lds.03.file_data_access.pptx.pdf |}}|  |  -** BI technology:** [[https://cacm.acm.org/magazines/2011/8/114953-an-overview-of-business-intelligence-technology/fulltext | An Overview of Business Intelligence Technology]] - **File access:** {{ :mds:lbi:filesystem.pdf | File System Interface}} - **File Formats:** [[http://www.stat.auckland.ac.nz/~paul/ItDT | Introduction to data technologies(Chps. 5, 6)]],  [[http://weka.wikispaces.com/ARFF+(stable+version)|Weka ARFF Format]], [[http://weka.wikispaces.com/XRFF|XRFF Format]] | Monreale |
-|2. |  17.09 11:00-13:00 | Python Recap  | {{ :mds:lbi:2020-lds.04.python.pptx.pdf |}}  | |Free Python book: http://www.spronck.net/pythonbook/ |Pellungrini|
-|3. |  22.09 11:00-13:00 | File Access in Python | {{ :mds:lbi:2020-lds.05.fileaccess-python.pptx.pdf |}} |  {{ :mds:lbi:census.csv.zip |}} {{ :mds:lbi:csv2arrf.py.zip |}} {{ :mds:lbi:data1.zip |Collection of files}}| |Pellungrini|
-|4. |  24.09 11:00-13:00 | Lab practice: XML2CSV/CSV2JSON file format conversion |  |{{ :mds:lbi:lds.file.format.zip |}} | |Pellungrini|
-|5. |  29.09 11:00-13:00 | Python Exercises  | {{ :mds:lbi:ex-customers.pdf |}} | {{ :mds:lbi:data-customers.zip |}} {{ :mds:lbi:ex-customers_solution.zip |}}| |Pellungrini|
-|6. |  01.10 11:00-13:00 |  RDBMS access protocols: ODBC, OLE DB, JDBC. ODBC Programming.   | {{ :mds:lbi:lbi.06.relational_data_access-complete.pdf |}}  |  |   | Monreale|
-|7. |  06.10 11:00-13:00 |  RDBMS access protocols: ODBC, OLE DB, JDBC. ODBC Programming.   | {{ :mds:lbi:lbi.06.relational_data_access-complete.pdf |}}  | {{ :mds:lbi:code-db-samples.zip |}}  |   | Monreale|
-|8. |  08.10 11:00-13:00 |  Stratified Sampling Ex, SQL Management Studio Demo, Project Explaination   | {{ :mds:lbi:lds.07.sqlserver.pdf |}}|{{ :mds:lbi:stratifiedsampling.zip |}} |   | Monreale, Pellungrini|
-|9. |  13.10 11:00-13:00 |  ETL, Sequel Server Data Tools Demo   | {{ :mds:lbi:lds.08.etlandssis.pdf |}} |{{ :mds:lbi:lds_first_project.zip |}} |   |Pellungrini|
-|10. |  15.10 11:00-13:00 |  SSIS exercises|  | {{ :mds:lbi:ex-midterm.pdf |}}|   |Pellungrini|
-|11. |  20.10 11:00-13:00 | stratified sampling with SSIS + SSIS practice | |{{ :mds:lbi:2015midterm1text.pdf |}}{{ :mds:lbi:lds_first_project.zip |}} |   | Monreale/Pellungrini|
-|12. |  22.10 11:00-13:00 | SSIS practice + Project support | |{{:mds:lbi:2015midterm1text.pdf |}} |   | Monreale/Pellungrini|
-|13. |  27.10 11:00-13:00 | SSIS: Surrogate Keys |  |  |   | Monreale/Pellungrini|
-|14. |  29.10 11:00-13:00 | SSIS: slowly changing dimensions |  |{{ :mds:lbi:2016ssis.zip |}}  |   | Monreale/Pellungrini|
-|15. |  03.11 11:00-13:00 | Datawarehousing and OLAP recap. Data cubes, analytic SQL, and materialized views in SQL Server. | {{ :mds:lbi:lds.09.dwandolap.pdf |}} | {{ :mds:lbi:lbi.08.afdemo.sql.zip |}} |   | Monreale/Pellungrini|
-|16. |  05.11 11:00-13:00 | OLAP with SQL Server Analysis Services (SSAS): data source views, dimensions, | {{ :mds:lbi:lds.09.dwandolap.pdf |}} {{ :mds:lbi:lds.10.ssas.pdf |}} |  |**1) SSAS (olap):** [[http://msdn.microsoft.com/en-us/library/bb522607.aspx|documentation]]; 2) S. Harinath et al. {{ :mds:lbi:ssas2012ch456.pdf |Professional Microsoft SQL Server Analysis Services 2012 with MDX and DAX, Wrox publisher, 2012. Chps. 4-6}}.  | Monreale/Pellungrini|
-|17. |  10.11 11:00-13:00 | OLAP with SQL Server Analysis Services (SSAS): dimensions, hierarchies. Data cubes, Parent-child hierarchies. OLAP explorative data analysis with Pivot Tables in Excel.|  {{ :mds:lbi:lds.10.ssas.pdf |}} |  {{ :mds:lbi:monreale_foodmart.zip |}} **Notice:** Please read the instructions in the Section NEWS! | **Pivot Tables in Excel:** G. Harvey. {{ :mds:lbi:pivottable2013bookviichpt2.pdf |Excel 2013 All-in-One For Dummies, 2013. Chp. VII-2}}.  | Monreale/Pellungrini|
-|18. |  12.11 11:00-13:00 | OLAP explorative data analysis with Pivot Tables in Excel.|   | {{ :mds:lbi:foodmartexplorative.xlsx |}} |  | Monreale/Pellungrini|
-|19. |  17.11 11:00-13:00 | Introduction to MDX |   |  | **MDX:** 1) [[http://msdn.microsoft.com/en-us/library/bb500184.aspx|documentation]] and a [[https://www.mssqltips.com/sqlservertip/3129/order-and-sort-with-mdx-in-sql-server-analysis-services/|useful guide on ordering]]; 2) S. Harinath ed al. {{ :mds:lbi:ssas2012ch3.pdf |Professional Microsoft SQL Server Analysis Services 2012 with MDX and DAX, Wrox publisher, 2012. Chp. 3.}}     | Monreale/Pellungrini|
-|20. |  19.11 11:00-13:00 | Introduction to MDX |   | {{ :mds:lbi:mdx-practice-2020.txt.zip |}} {{ :mds:lbi:mdx-ex.pdf |}}|  | Monreale |
-|21. |  24.11 11:00-13:00 | Practice on MDX |   | {{ :mds:lbi:lbi.09.mdxsample.mdx.zip |}} {{ :mds:lbi:lbi.09.mdxpractice.mdx.zip |}} | | Pellungrini|
-|22. |  25.11 11:00-13:00 | project check |   |Please do exercize on MDX. Here: {{ :mds:lbi:ex-mdx.pdf |}} you can find other queries that we will solve during the next lectures |  | Monreale/Pellungrini |
-|23. |  01.12 11:00-13:00 | Microstrategy presentation |   |  |  | Monreale/Pellungrini|
-|24. |  03.12 11:00-13:00 | PowerBI Desktop + Correction Ex. MDX | {{ :mds:lbi:lds.12.powerbi.pdf |}}  | {{ :mds:lbi:mdx-corrections.mdx.zip |}}|  | Monreale/Pellungrini |
-|25. |  10.12 11:00-13:00 | Microstrategy Viz|   | {{ :mds:lbi:mircostrategy-material.zip |}} If you nee the password please check the common chat in Temas, or wirte an email to the teachear.|  | Monreale/Pellungrini|
+**PROJECT **
+A project consists of a set of assignments corresponding to a BI process: data integration, construction of an OLAP cube, querying of the OPLAP cube, and reporting.
+The project has to be performed by a team of 3 students.
-====== Exams ======
+Each part of the project **must be documented** with a brief pdf report (no more than 5 pages) describing your solution.
-**PROJECT **
+**Project to be delivered within 27/12/2024 **
+  * **Dataset:**
+**Project to be delivered during the exam sessions **
+Students who did not deliver the above project by 27/12/2024 need to ask by email a new project to the teachers. The project that will be assigned will require about 2 weeks of work. After the delivery, the project will be discussed during the oral exam. For those students, the oral exams will also cover some practical parts that could not be included in the project. ** Please write to all teachers!**
-A project consists in a set of assignements corresponding to a BI process: data integration, construction of an OLAP cube, qurying of a OPLAP cube and reporting.
-The project has to be performed by a team of 2 students (at most 3 after asking authorization for that to the teachers).
+===== Exam sessions =====
-  * First part of the project consists in the **assignments** described here: {{ :mds:lbi:lds_project_2020.pdf | Project Description Part 1}}
+Registration to the written exam is mandatory (**pay attention at the deadline for registering!**): [[https://esami.unipi.it/esami2/|register here]]\\
-  * Second part of the project cosist in the **assignments** described here: {{ :mds:lbi:lds_project_2020_part_2.pdf | Project Description Part 2}}
-  * Third part of the project cosist in the **assignments** described here: {{ :mds:lbi:lds_project_2020_part_3.pdf | Project Description Part 3}}
-  * Remember to re-submit all three parts of the project with your third part, as specified in the document above.
-  * **Dataset:** {{ :mds:lbi:project_data.zip |}}
-  * **Deadline**: the fist part has to be delivered within ** November, 18th 2020.**
-  * **Deadline**: the second part has to be delivered within ** December, 4th  2020.**
-  * **Deadline**: the third part has to be delivered within ** December, 31st  2020.**
-===== Mid-term exams =====
-===== Exam sessions =====
-^ Session ^ Date            ^ Time        ^ Room   ^ Notes ^ Marks ^
+Please indicate in the notes "Only Lab" for doing only the discussion of the lab project; "Only DSD" for doing only the written+oral part of the DSD module; or "DSD+Lab" for doing both.
-=====Extra sessions A.A. 2019/20=====
+**Important:** the date of the discussion of the lab project will be communicated to you. The dates at the
+[[https://esami.unipi.it/esami2/|registration website]] regard **only** the written part of the DSD module.
-^  Date            ^ Time        ^ Room   ^ Notes ^ Results ^
-| |  | | | |
 =====Past Editions =====
+  * [[LDS 2023-2024]]
+  * [[LDS 2022-2023]]
+  * [[LDS 2021-2022]]
+  * [[LDS 2020-2021]]
   * [[LDS 2019-2020]]
   * [[LDS 2018-2019]]
   * [[LBI 2017-2018]]
-  * [[http://pages.di.unipi.it/ruggieri/teaching/_lbi/|LBI 2016/2017]]