BIOSTAT 216: Machine Learning in R for the Biomedical Sciences: Methods for Prediction, Pattern Recognition, and Data Reduction (Spring 2019)
Section outline
-
-
Biostat 216 Forum
-
Lecture: What is Machine Learning? Introductory concepts
Data types: continuous, binary, categorical, survival, count: introduce datasets for each to be used in the course. Supervised vs. Unsupervised learning. Overview of prediction techniques for supervised learning. Regression tree and support vector machine overview example in R for binary data – discuss overfitting, tuning parameters. Discuss explanatory models vs. black box prediction (comparing regression tree with SVM). Provide an initial look at how to choose a predictive model.
Faculty: John Kornak
Location: MH-1407-
Watch URL
-
Lab
Faculty: John Kornak
Location: MH-1407-
Biostat216Lab1v2 solutions File
-
Biostat216Lab1v2 solutions File
-
Lecture: Model/algorithm evaluation/choice
Model/algorithm evaluation for each data type: e.g. for binary accuracy, AUC for ROC, and Gini Index. Concept of “predictor importance”. Training-test, training-validation-test, cross-validation, nested cross-validation, reserving data -- cross-validate ~2/3 of data and reserve ~1/3 for model evaluation.
Faculty: John Kornak
Location: MH-1407-
Watch URL
-
Lab:
Faculty: John Kornak
Location: MH-1407-
Biostat216Lab2v2solutions File
-
Biostat216Lab2v2solutions File
-
Discussion Section:
Faculty: John Kornak
Location: MH-1407 -
Lecture: Linear Algebra, Optimization and Validation
Faculty: John Kornak
Location: MH 1407-
Watch URL
-
Biostat216HW1v3solutions File
-
Biostat216HW1v3solutions File
-
Lab:
Faculty: John Kornak
Location: MH 1407-
Biostat216Lab3v1solutions File
-
Biostat216Lab3v1solutions File
-
lab3 File
-
Lecture: Support Vector Machines
Support Vector Machines (linear and nonlinear) – background methodology, theory and application in R (e1071, kernlab) – illustrate training-validation-testFaculty: John Kornak
Location: Genentech North 114-
Watch URL
-
Lab:
Faculty: John Kornak
Location: Genentech North 114-
Biostat216Lab4v1revisedPostLabSolutions File
-
Biostat216Lab4v1revisedPostLabSolutions File
-
Discussion Section:
Faculty: John Kornak
Location: Genentech North 114 -
Lecture: Regression Trees and Random Forests
Motivation for, and underpinnings of, the classification and regression tree paradigm will be detailed along with illustrative applications. Shortcomings of the technique will be identified and the means whereby these can be redressed by random forests described. Properties of random forests will be highlighted and examples presented.
Faculty: Mark Segal
Location: Genentech North 114-
Watch URL
-
Biostat216HW2v1solutions File
-
Biostat216HW2v1solutions File
-
Lab:
Faculty: John Kornak
Location: Genentech North 114-
Assignment Answer Key (Access restricted to registered students):
-
lab5trees File
-
lab5trees File
-
lab5trees File
-
lab5trees File
-
Lecture: Concepts of boosting and gradient boosting
Concepts of boosting, gradient boostingFaculty: Gilmer Valdes
Location: Genentech North 114-
Watch URL
-
Homework3solutions File
-
Homework3solutions File
-
Homework3solutions File
-
Lab:
Faculty: John Kornak
Location: Genentech North 114-
lab6boostingRevisedPostLecture File
-
lab6boostingRevisedPostLecture File
-
lab6boostingRevisedPostLecture File
-
Discussion Section:
Faculty: John Kornak
Location: Genentech North 114 -
Lecture: Penalized regression methods
Motivation via multiple linear regression, ridge regression, lasso, elastic net, extensions/inference – discuss in context of continuous, binary, categorical, continuous, and survival endpoints -- illustrate training-validation-test
Faculty: Mark Segal
Location: MH-1407-
Watch URL
-
Homework4solutions File
-
Homework4solutions File
-
Homework4solutions File
-
Homework4solutions File
-
Lecture: Unsupervised learning: Clustering and Data reduction algorithms
Clustering algorithms – K-means, Silhouette measure, Mixture models, hierarchical clustering – measures for choosing number of clusters. Data reduction algorithms – Principal components analysis (PCA) and Independent components analysis (ICA) -- measures for choosing number of componentsFaculty: John Kornak
Location: MH-1407-
Watch URL
-
Discussion Section:
Faculty: John Kornak
Location: MH-1407 -
Lecture: Applications lecture: clustering and classification of high-dimensional data in a genomic context
Clustering and classification of high-dimensional data in a genomic contextFaculty: Adam Olshen
Location: MH-1407-
Watch URL
-
Homework5solutions File
-
Homework5solutions File
-
Homework5solutions File
-
Homework5solutions File
-
Lab
Faculty: John Kornak
Location: MH-1407 -
Discussion
Faculty: John Kornak
Location: MH-1407 -
Lecture: The rtemis Machine Learning R package
Overview of the rtemis package: emphasizing ability to (and importance thereof) perform nested cross-validation
Faculty: Efstathios Gennatas
Location: Genentech North 114
-
Watch URL
-
Lab
Faculty: John Kornak
Location: MH-1407
