Section outline

  • Lecture: What is Machine Learning? Introductory concepts

    Data types: continuous, binary, categorical, survival, count: introduce datasets for each to be used in the course. Supervised vs. Unsupervised learning. Overview of prediction techniques for supervised learning. Regression tree and support vector machine overview example in R for binary data – discuss overfitting, tuning parameters. Discuss explanatory models vs. black box prediction (comparing regression tree with SVM). Provide an initial look at how to choose a predictive model.

    Faculty:  John Kornak

    Please watch 2019 recorded lectures

  • Lab

    Faculty:  John Kornak
    • Assignment: Optional narrative description

    • Assignment Answer Key (Access restricted to registered students):

    • Biostat216Lab1v2 solutions File
    • Biostat216Lab1v2 solutions File
  • Lecture: Model/algorithm evaluation/choice

    Model/algorithm evaluation for each data type: e.g. for binary accuracy, AUC for ROC, and Gini Index. Concept of “predictor importance”. Training-test, training-validation-test, cross-validation, nested cross-validation, reserving data -- cross-validate ~2/3 of data and reserve ~1/3 for model evaluation.

    Faculty:  John Kornak

    Please watch 2019 recorded lectures

  • Lab:

    Faculty:  John Kornak

    • Assignment: Optional narrative description

    • Assignment Answer Key (Access restricted to registered students):

    • Biostat216Lab2v3solutions File
    • Biostat216Lab2v3solutions File
  • Discussion Section:

    Faculty:  John Kornak


  • Lecture: Linear Algebra, Optimization and Validation


    Faculty:  John Kornak

    Please watch 2019 recorded lectures

    • Session Slides:

    • Session Audio/Video Recording (Access restricted to registered students):

    • Watch 2019 Recording URL
      Not available unless: You belong to a group in Registered Students Only
    • Assignment Due Date:  Due Monday, April 27

    • Assignment Answer Key (Access restricted to registered students):

    • Biostat216HW1v3solutions File
    • Biostat216HW1v3solutions File
  • Lab:

    Faculty:  John Kornak

    • Assignment: Optional narrative description

    • Assignment Answer Key (Access restricted to registered students):

    • Biostat216Lab3v1solutions File
    • Biostat216Lab3v1solutions File
    • lab3 File
  • Lecture:  Support Vector Machines
    Support Vector Machines (linear and nonlinear) – background methodology, theory and application in R (e1071, kernlab) – illustrate training-validation-test

    Faculty:  John Kornak

    Please watch 2019 recorded lectures

  • Lab:

    Faculty:  John Kornak

    • Assignment: Optional narrative description

    • Assignment Answer Key (Access restricted to registered students):

    • Biostat216Lab4v1 solutions 2020version File
    • Biostat216Lab4v1 solutions 2020version File
    • lab4 updated2020 File
  • Discussion Section:

    Faculty:  John Kornak
    • Required Reading:

  • Lecture: Regression Trees and Random Forests

    Motivation for, and underpinnings of, the classification and regression tree paradigm will be detailed along with illustrative applications.  Shortcomings of the technique will be identified and the means whereby these can be redressed by random forests described.  Properties of random forests will be highlighted and examples presented.

    Faculty:  Mark Segal


    Please watch 2019 recorded lectures

    • Session Slides:

    • Session Audio/Video Recording (Access restricted to registered students):

    • Watch 2019 Recording URL
      Not available unless: You belong to a group in Registered Students Only
    • Assignment Due Date: Monday, May 11th.

    • Assignment Answer Key (Access restricted to registered students):

    • Biostat216HW2v1solutions File
    • Biostat216HW2v1solutions File
  • Lab:

    Faculty:  John Kornak
    • Assignment Due Date:  (e.g.,  1 pm on April 1 2013” or  “At the beginning of Small Group Section”)

    • Assignment Answer Key (Access restricted to registered students):

    • lab5trees File
    • lab5trees File
    • lab5trees File
    • lab5trees File
  • Lecture: Concepts of boosting and gradient boosting
    Concepts of boosting, gradient boosting

    Faculty:  Gilmer Valdes

    Please watch 2019 recorded lectures

    • Session Slides:

    • Session Audio/Video Recording (Access restricted to registered students):

    • Watch 2019 Recording URL
      Not available unless: You belong to a group in Registered Students Only
    • Assignment Due Date:  Monday, May 18th.

    • Assignment Answer Key (Access restricted to registered students):

    • Homework3solutions File
    • Homework3solutions File
    • Homework3solutions File
  • Lab:

    Faculty:  John Kornak 
    • Assignment Due Date:  (e.g.,  1 pm on April 1 2013” or  “At the beginning of Small Group Section”)

    • Assignment Answer Key (Access restricted to registered students):

    • lab6boosting File
    • lab6boosting File
    • lab6boosting File
  • Discussion Section:

    Faculty:  John Kornak

  • Lecture:  Penalized regression methods

    Motivation via multiple linear regression, ridge regression, lasso, elastic net, extensions/inference – discuss in context of continuous, binary, categorical, continuous, and survival endpoints -- illustrate training-validation-test

    Faculty:  Mark Segal

    Please watch 2019 recorded lectures

    • Session Slides:

    • Session Audio/Video Recording (Access restricted to registered students):

    • Watch 2019 Recording URL
      Not available unless: You belong to a group in Registered Students Only
    • Assignment Due Date:  Friday, May 29th.

    • Assignment Answer Key (Access restricted to registered students):

    • Homework4solutions File
    • Homework4solutions File
    • Homework4solutions File
    • Homework4solutions File
  • Lab:

    Faculty:  John Kornak

    Location: MH-1407  

    • Assignment Due Date:  (e.g.,  1 pm on April 1 2013” or  “At the beginning of Small Group Section”)

    • Assignment Answer Key (Access restricted to registered students):

    • lab7penalizedRegressionSolutions File
      Available until end of June 30, 2020
  • Lecture: Unsupervised learning: Clustering and Data reduction algorithms
    Clustering algorithms – K-means, Silhouette measure, Mixture models, hierarchical clustering – measures for choosing number of clusters. Data reduction algorithms – Principal components analysis (PCA) and Independent components analysis (ICA) -- measures for choosing number of components

    Faculty: John Kornak

    Please watch 2019 recorded lectures

    • Session Slides:

    • Session Audio/Video Recording (Access restricted to registered students):

    • Watch 2019 Recording URL
      Not available unless: You belong to a group in Registered Students Only
    • Assignment Due Date:  June 3rd, 2020

    • Assignment Answer Key (Access restricted to registered students):

  • Lab:

    Faculty:  John Kornak

    Location: MH-1407   

    • Assignment Answer Key (Access restricted to registered students):

    • lab8unsupervisedSolutions File
      Available until end of June 30, 2020
    • lab8unsupervisedSolutions File
      Available until end of June 30, 2020
    • lab8unsupervisedSolutions File
      Available until end of June 30, 2020
    • Assignment Due Date:  (e.g.,  1 pm on April 1 2013” or  “At the beginning of Small Group Section”)

  • Lecture:  Applications lecture: clustering and classification of high-dimensional data in a genomic context
    Clustering and classification of high-dimensional data in a genomic context

    Faculty:  Adam Olshen

    Please watch 2019 recorded lectures 

    • Session Slides:

    • Session Audio/Video Recording (Access restricted to registered students):

    • Watch 2019 Recording URL
      Not available unless: You belong to a group in Registered Students Only
    • Assignment Due Date: Monday, June 8th.

    • Assignment Answer Key (Access restricted to registered students):

    • Homework5solutions File
    • Homework5solutions File
    • Homework5solutions File
    • Homework5solutions File
  • Lab

    Faculty:  John Kornak

    • Assignment Due Date:  (e.g.,  1 pm on April 1 2013” or  “At the beginning of Small Group Section”)

    • Assignment Answer Key (Access restricted to registered students):

  • Discussion

    Faculty:  John Kornak

    • Session Slides:

    • Required Reading:

  • Lecture: The rtemis Machine Learning R package

    Overview of the rtemis package: emphasizing ability to (and importance thereof) perform nested cross-validation

    Faculty:  Efstathios Gennatas

    Please watch 2019 recorded lectures

    • Session Slides:

    • Session Audio/Video Recording (Access restricted to registered students):

    • Watch 2019 Recording URL
      Not available unless: You belong to a group in Registered Students Only
  • Lab

    Faculty:  John Kornak