Model Validation and Uncertainty Quantification

Week 10 (18 Nov 2023 - 22 Nov 2023)

Evaluating models with cross validation and uncertainty quantification with bootstrap confidence intervals.

Lectures

No.
Title
Slides
Additional
19 Cross Validation Raw
20 Uncertainty Quantification Raw

Lecture Recordings
Lecture recordings are only available for IDS students via the University of Edinburgh virtual learning environment. To access the recordings, go to the Introduction to Data Science area on LEARN ULTRA and select Lecture Recordings under the Course Content section. This will open echovideo where you will find a list of all lecture recordings to watch once they become available.

Tasks

  1. Watch the Videos and reading.
  2. Complete the Assignments.

Videos and reading

Some of this material is required and some of it is optional. We expect you to watch the required videos and read the required reading. This required material is part of the course so it may be assessed in the assignments and it may not be covered in the lectures. The optional material is extra reading for those that are interested!

tidymodels: Evaluate your model with resampling Required
IMS: Chp 12 - Confidence intervals with bootstrapping Required

Workshop

Laboratory Title
Links
Date
Project
  • Instructions
  • Fri, 22 Nov

    Assignment

    The third homework assignment (hw-03) is due by the end of this week. You will find more information about the assignment here.

    If you are having difficulty accessing your homework or lab repository, see troubleshooting advice here.