EPI 228: Measurement Theory and Practice (Fall 2018)
Section outline
-
-
Measurement Theory and Practice
EPI 228 Fall 2018 (2 units).
Course Director: Lydia B. Zablotska, MD, MPA, PhD.
Professor, Department of Epidemiology and Biostatistics -
Instrument Files (70) Folder
-
Instrument Listings Folder
-
Instruments for Student Oral Presentations on 12/13 Forum
-
-
Lecture: Introduction to measurement theory: Phenomena, conceptual frameworks and tools to capture them
Operationalization of theoretical concepts from research questions into measurable indicators; phenomena vs. domains vs. concepts vs. conceptual models vs. conceptual frameworks; introduction to scales, the most common measurement approach in health research; types of scales and statistical underpinnings of scale measurement.
Faculty: Lydia Zablotska
Location: MH-1106 -
Lecture: Quantitative approaches to validity
Traditional definitions of validity (3 C’s: Content, Criterion and Construct validity) and statistical methods to assess them (Index and Rovinelli & Hambleton Index for Content validity; correlation coefficients and multiple regression for Criterion-related validity; Multitrait-Multhimethod Matrix, Spearman correlation coefficient, chi-square and ANOVA (Factor Analysis) for Construct validity); new theories on validity of instruments (Goodman’s 24 types of validity); Consequential validity in health research.
Faculty: Lydia Zablotska
Location: MH-1106 -
Seminar: Practice translating from research question to measurement instruments
Faculty: Lydia Zablotska
Location: MH-1106
-
Practice examples File
-
-
Lecture: Reliability in quantitative measurement
Relationship between reliability and validity; different classifications of reliability measures; main types of reliability measurements and associated statistical tests (Test-retest (ICC, t-tests, Pearson’s correlation coefficient); Parallel/ alternate forms (Pearson’s correlation coefficient, Spearman Brown correlation); Internal consistency (coefficient alpha and its variants); Inter-rater agreement (Cohen’s kappa and ICC)).
Faculty: Lydia Zablotska
Location: MH-1106 -
Seminar: Review of Homework Assignment #1 (Validity)
Faculty: Lydia Zablotska
Location: MH-1106
-
Lecture: Standardized approaches to measurement
Types of measurement frameworks (norm-referenced vs. criterion-referenced); standardized measurement instruments; standards, norms and methods of standardization; publicly available sources of standardized measurement instruments.
Faculty: Lydia Zablotska
Location: MH-1106-
Slides for week #6 File
-
Analysis workshop #1: Computation of Cronbach's alpha, Cohen’s kappa and intra-class correlation coefficients (ICCs) using Stata
Faculty: Lydia Zablotska
Location: MH-1106
-
Validity and Reliability Tutorial File
-
Analysis Workshop #1 Tutorial with Stata commands File
-
Analysis Workshop #1 Answer Key File
-
Lecture: Classical and modern measurement theory. Introduction to generalizability theory
Classical measurement theory: its advantages and limitations; Modern measurement theories (Generalizability theory (GT) and Item Response theory); basic principles of GT and its use in measurement frameworks; basic principles of estimation of g-coefficient using ANOVA; steps for making decisions about measurement scheme using g-coefficient.
Faculty: Lydia Zablotska
Location: MH-1106 -
Seminar: Review of Homework Assignment #2 (Reliability)
Faculty: Lydia Zablotska
Location: MH-1106
-
Lecture: Field research methods: Introduction to instrumentation and data collection methods
Design methods for quantitative (observational) and qualitative studies; sources and procedures for collection of measurement information (Questionnaires, Interviews: structured (standardized), unstructured, Types of questions: closed-ended and open-ended); data collection methods (‘field methods’): procedures for developing study protocols; protocols for interview administration; Operations Manuals; staff training and re-training, certification; quality control measures; assessment of study progress; ways to deal with problems in subject recruitment/retention.
Faculty: Lydia Zablotska
Location: MH-1106 -
Analysis workshop #2: Generalizability theory
Faculty: Lydia Zablotska
Location: MH-1106
-
Analysis Workshop #2 tutorial with Stata commands File
-
Analysis Workshop #2 Answer Key File
-
GT example_calculations File
-
Analysis Workshop #2 slides File
-
Lecture: Methods of test development I
Methods of test development using CTT and Item analysis (based on Item response theory (IRT)); uses of IRT in computer-assisted testing (CAT); summary of CTT vs. GT. vs. IRT, advantages and limitations.
Faculty: Lydia Zablotska
Location: MH-1106 -
Seminar: Review of Homework Assignment #3 (Written evaluation of reliability and validity of standardized instruments)
Faculty: Lydia Zablotska
Location: MH-1106
-
Lecture: Methods of test development II
Main principles and practical steps in measurement instrument development; going from items to scales using item weighing and other methods; ROC and AUC; basic principles of Factor Analysis/ Principal Component Analysis.
Faculty: Lydia Zablotska
Location: MH-1106 -
Seminar: Review of Homework Assignment #4 (Field research methods)
Faculty: Lydia Zablotska
Location: MH-1106
-
Lecture: Methods of test development III
Design of instrument for collection of sensitive subject information: ethical considerations; conduct of research in vulnerable populations; construction and interpretation of instruments in cross-cultural situations; best practices for selection of standardized instruments suitable for your own research question.
Faculty: Lydia Zablotska
Location: MH-1106 -
Analysis workshop #3: Factor analysis/ Principal Component Analysis
Faculty: Lydia Zablotska
Location: MH-1106
-
Seminar: Review of Homework Assignment #5 (Test development examples)
Student oral presentations and class discussion
Faculty: Lydia Zablotska
Location: MH-1106