This week’s topics
Data Preprocessing Pitfalls and Data Quality
- Handling missing data and imputation bias
- Anomaly and outlier detection
- Data leakage and class imbalance
- The Trouble with Missing Data - Computerphile
- What is data quality? - Dr Olga Maslovskaya
- Data Preprocessing in ML
What you will be able to do
- 2.1 Evaluate analytical model data preparation processes.
- 2.2 Critically evaluate potential issues in the preparation of data for use in an applied analytical model.
Activity
Start with this week’s 3 videos, then: Seminar, guided reading and a short written task: evaluate analytical model data preparation processes.
Study materials
Videos
- The Trouble with Missing Data - Computerphile · YouTube · Computerphile · 10 min · for registered students
- What is data quality? - Dr Olga Maslovskaya · YouTube · National Centre for Research Methods (NCRM) · 19 min · for registered students
- Data Preprocessing in ML · YouTube · Neso Academy · 23 min · for registered students
Further resources
- Principles of Data Science, ch. 2: Collecting and Preparing Data · PDF · OpenStax, textbook chapter; pp. 67–112 · for registered students
- MIT 15.071 The Analytics Edge (Spring 2017) · Reading · MIT OpenCourseWare, course · for registered students
Materials marked “for registered students” open in the student portal, which is set up as soon as you receive final acceptance.