BIOSTAT 216: Machine Learning in R for the Biomedical Sciences: Methods for Prediction, Pattern Recognition, and Data Reduction (Spring 2020)
Section outline
-
-
Biostat 216 Forum
-
Lecture: What is Machine Learning? Introductory concepts
Data types: continuous, binary, categorical, survival, count: introduce datasets for each to be used in the course. Supervised vs. Unsupervised learning. Overview of prediction techniques for supervised learning. Regression tree and support vector machine overview example in R for binary data – discuss overfitting, tuning parameters. Discuss explanatory models vs. black box prediction (comparing regression tree with SVM). Provide an initial look at how to choose a predictive model.
Faculty: John Kornak
Please watch 2019 recorded lectures-
Watch 2019 Recording URL
-
Lab
Faculty: John Kornak-
Biostat216Lab1v2 solutions File
-
Biostat216Lab1v2 solutions File
-
Lecture: Model/algorithm evaluation/choice
Model/algorithm evaluation for each data type: e.g. for binary accuracy, AUC for ROC, and Gini Index. Concept of “predictor importance”. Training-test, training-validation-test, cross-validation, nested cross-validation, reserving data -- cross-validate ~2/3 of data and reserve ~1/3 for model evaluation.
Faculty: John Kornak
Please watch 2019 recorded lectures-
Watch 2019 Recording URL
-
Lab:
Faculty: John Kornak
-
Biostat216Lab2v3solutions File
-
Biostat216Lab2v3solutions File
-
Discussion Section:
Faculty: John Kornak -
Lecture: Linear Algebra, Optimization and Validation
Faculty: John Kornak
Please watch 2019 recorded lectures
-
Watch 2019 Recording URL
-
Biostat216HW1v3solutions File
-
Biostat216HW1v3solutions File
-
Lab:
Faculty: John Kornak
-
Biostat216Lab3v1solutions File
-
Biostat216Lab3v1solutions File
-
lab3 File
-
Lecture: Support Vector Machines
Support Vector Machines (linear and nonlinear) – background methodology, theory and application in R (e1071, kernlab) – illustrate training-validation-testFaculty: John Kornak
Please watch 2019 recorded lectures
-
Watch 2019 Recording URL
-
Lab:
Faculty: John Kornak
-
Biostat216Lab4v1 solutions 2020version File
-
Biostat216Lab4v1 solutions 2020version File
-
lab4 updated2020 File
-
Discussion Section:
Faculty: John Kornak -
Lecture: Regression Trees and Random Forests
Motivation for, and underpinnings of, the classification and regression tree paradigm will be detailed along with illustrative applications. Shortcomings of the technique will be identified and the means whereby these can be redressed by random forests described. Properties of random forests will be highlighted and examples presented.
Faculty: Mark Segal
Please watch 2019 recorded lectures-
Watch 2019 Recording URL
-
Biostat216HW2v1solutions File
-
Biostat216HW2v1solutions File
-
Lab:
Faculty: John Kornak-
Assignment Answer Key (Access restricted to registered students):
-
lab5trees File
-
lab5trees File
-
lab5trees File
-
lab5trees File
-
Lecture: Concepts of boosting and gradient boosting
Concepts of boosting, gradient boostingFaculty: Gilmer Valdes
Please watch 2019 recorded lectures-
Watch 2019 Recording URL
-
Homework3solutions File
-
Homework3solutions File
-
Homework3solutions File
-
Lab:
Faculty: John Kornak-
lab6boosting File
-
lab6boosting File
-
lab6boosting File
-
Discussion Section:
Faculty: John Kornak
-
Lecture: Penalized regression methods
Motivation via multiple linear regression, ridge regression, lasso, elastic net, extensions/inference – discuss in context of continuous, binary, categorical, continuous, and survival endpoints -- illustrate training-validation-test
Faculty: Mark Segal
Please watch 2019 recorded lectures-
Watch 2019 Recording URL
-
Homework4solutions File
-
Homework4solutions File
-
Homework4solutions File
-
Homework4solutions File
-
Lab:
Faculty: John Kornak
Location: MH-1407-
lab7penalizedRegressionSolutions File
-
Lecture: Unsupervised learning: Clustering and Data reduction algorithms
Clustering algorithms – K-means, Silhouette measure, Mixture models, hierarchical clustering – measures for choosing number of clusters. Data reduction algorithms – Principal components analysis (PCA) and Independent components analysis (ICA) -- measures for choosing number of componentsFaculty: John Kornak
Please watch 2019 recorded lectures-
Watch 2019 Recording URL
-
Lab:
Faculty: John Kornak
Location: MH-1407-
lab8unsupervisedSolutions File
-
lab8unsupervisedSolutions File
-
lab8unsupervisedSolutions File
-
Lecture: Applications lecture: clustering and classification of high-dimensional data in a genomic context
Clustering and classification of high-dimensional data in a genomic contextFaculty: Adam Olshen
Please watch 2019 recorded lectures-
Watch 2019 Recording URL
-
Homework5solutions File
-
Homework5solutions File
-
Homework5solutions File
-
Homework5solutions File
-
Lab
Faculty: John Kornak
-
Discussion
Faculty: John Kornak
-
Lecture: The rtemis Machine Learning R package
Overview of the rtemis package: emphasizing ability to (and importance thereof) perform nested cross-validation
Faculty: Efstathios Gennatas
Please watch 2019 recorded lectures
-
Watch 2019 Recording URL
-
Lab
Faculty: John Kornak
