Section outline

  • General

    Collapse all Expand all

  • Thursday, September, 18, 2014; 8:45 AM - 10:15 AM

    Lecture: Introduction to Evaluation/Purpose of Evaluation/Describing the Program, Logic Models, part 1

    1. Define program evaluation and understand how evaluation can support program planning, implementation and accountability. 2. Explore the key terms and concepts associated with program evaluation. 3. Describe program theory and program logic 4. Identify elements of program theory/logic in selected case studies.

    Faculty:  Janet Myers

    Location:      China Basin 5759

    • Prospectus:

    • Session 1 Overview 2014 File

    • Session Slides:

    • Required Reading:

      Weiss, Carol. Evaluation. Chapter 1-3

    • AEA Guiding Principles URL
    • Kiosk Case Study Folder
      Not available unless: Your ID number contains 02
    • MARC Case study Folder
      Not available unless: Your ID number contains 02

    • Optional Reading:

    • Hatry HP. (2013). Sorting the Relationships among Performance Measurement, Program Evaluation and Performance management. New Directions for Evaluation, 137:19-32 File
      Not available unless: Your ID number contains 02
    • Rossi, Chapter 1. File
      Not available unless: Your ID number contains 02
    • Liket KC, Rey-Garcia M, Maas KEH. (2014). Why aren’t evaluations working and what to do about it: A framework for negotiating meaningful evaluation in nonprofits. American Journal of Evaluation, 35(2):171-188. File
      Not available unless: Your ID number contains 02

    • Assignment:

      For students who are using a known or active project as their “case” for discussion, identify the goal/s, objective/s and activities associated with the program’s plan.  If you want to use a logic model to do this, that’s fine.  Identify the goals, assumptions, target population, inputs and resources, activities and outputs of the program or project. 

       For students who are not using their own project, identify for either MARC, IMPAACT or Kiosks, the program logic or theory, goals, assumptions, target population, inputs and resources, activities and outputs of the program or project. 

    • Assignment Due Date:  Thursday, October 2, 2014 at the beginning of class.

       

  • Thursday, September 25, 2014; 8:45 AM - 10:15 AM

    Lecture: Evaluation Planning and Design, Logic Models, part 2

    1. Describe summative and formative evaluations; 2. Explore the strength of different types of evaluation designs; 3. Attribute outcomes to the program/understand the role of causality in rigorous evaluation; 4. Plan an evaluation/developing good evaluation questions.

    Faculty:  Janet Myers

    Location:      China Basin 5759

    • Prospectus:

    • Session 2 Overview 2014 File

    • Session Slides:

    • Required Reading:

      Weiss, Carol. Evaluation. Chapter 4, 6 & 8
      Daponte, Osborne. Evaluation Essentials. Chapter 4 & 5
      Bradford Hill criteria for causality

    • CDC-Evaluation-Workbook-508(3) File
      Not available unless: Your ID number contains 02
    • W.K. Kellogg Foundation Evaluation Handbook, W.K. Kellogg Foundation, 2004 File
      Not available unless: Your ID number contains 02
    • Kellogg Logic Model Development Guide File
      Not available unless: Your ID number contains 02
    • Osborne Duponte Chapters 4 5 File
      Not available unless: Your ID number contains 02
    • Lucas RM, McMichael AJ. (2005). Association or causation: evaluating links between “environment and disease.” Bulletin of the World Health Organization, 83(10):792-795 File
      Not available unless: Your ID number contains 02

    • Optional Reading:

      Weiss, Carol. Evaluation. Chapter 5 & 7

    • Assignment:

      For students who are using a known or active project as their “case,” finish your “logic model” or program plan by identifying the outcomes associated with your program or project.   Pay particular attention to causality and the evidence you plan to use to justify your conclusions (validity).  You can begin describing each of the logic model components in your evaluation plan narrative, the first section of which will be due next week. 

       

      For students who are not using their own project:

      1. For the case you chose for the first assignment, describe whether you think the evaluation design was the most rigorous and if not, which design you would recommend (from Weiss Chapter 8).

    • Assignment Due Date:  Homework due October 2, 2014

  • Thursday, October 2, 2014; 8:45 AM - 10:15 AM

    Lecture: Frameworks and Approaches used in Public Health Settings

    Faculty:  Alice Gandelman

    Location:      China Basin 5759

    • Session 3 Overview 2014 File
    • Alice Gandelman - TICR Oct 2014 File

    • Required Reading:

    • CDC Framework for PE in PH 1999 File
      Not available unless: Your ID number contains 02
    • MMWR Article URL
    • Program Evaluation: READ Framework, Steps, Standards, and Conducting Strong Evaluations. SKIM Framework-Based Materials and Other Evaluation Resources URL
    • Questions Approach: Organizing Framework for a Functional National HIV Monitoring and Evaluation System. 2008. UNAIDS. Available at: URL
      Not available unless: Your ID number contains 02
    • Precede Proceed Intro File
      Not available unless: Your ID number contains 02
    • Gandelman Soc Det Health File
      Not available unless: Your ID number contains 02
    • Berkowitz VERB File
      Not available unless: Your ID number contains 02

    • Optional Reading:

    • Li Precede Proceed Case Study File
      Not available unless: Your ID number contains 02
    • Watson Oral Heatlh Promotion File
      Not available unless: Your ID number contains 02

  • Thursday, October 9, 2014; 8:45 AM - 10:15 AM

    Lecture: Frameworks/Approaches used in Clinical Settings, Part 1 (Re-Aim and CFIR)

     

    Faculty:  Margaret Handley

    Location:      China Basin 5759

    • Prospectus:

    • Session 4 Overview 2014 File

    • Required Reading:

    • Greenhalgh T, Rober G, MacFarlane F et al. 2004. Diffusion of innovations in service organizations: systematic review and recommendations. A conceptual framework for implementation fidelity. Implementation Science 2007, 2:40. File
      Not available unless: Your ID number contains 02
    • Kitson AL et al. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implementation Science 2008, 3:1. File
      Not available unless: Your ID number contains 02
    • Helfrich CD, Damschroder LJ, Hagedorn HJ et al. A critical synthesis of literature on the promoting action on research implementation in health services (PARIHS) framework. Implementation Science 2010, 5:82. File
      Not available unless: Your ICQ number contains 02
    • Helfrich CD et al. Organizational readiness to change assessment (ORCA): Development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implementation Science 2009, 4:38 File
      Not available unless: Your ID number contains 02
    • Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Quality and Safety in Healthcare. 2005;14(1):26-33 File
      Not available unless: Your ID number contains 02
    • Cane J, O’Connor D, Michie S. et al. Validation of the theoretical domains framework for use in behavior change and implementation research. Implementation Science 2012: 7:37 File
      Not available unless: Your ID number contains 02
    • Keith FOI File
      Not available unless: Your ID number contains 02
    • Rycroft-Malone PARIHS example File
      Not available unless: Your ID number contains 02

    • Assignment Due Date: October 9, 2014

  • Thursday, October 16, 2014; 8:45 AM - 10:15 AM

    Lecture: Frameworks/Approaches used in Clinical Settings, Part 2 (FOI, PARIHS & ORCA)

    Lecturer: Margaret Handley

    Location:  China Basin 5759

    • Prospectus:

    • Session 5 Overview 2014 File

    • Required Reading:

    • Damschroder LJ, Aron DC, Keith, Kirsh SR, Alexander JA and Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Science 2009;4:50 File
      Not available unless: Your ID number contains 02
    • CFIR-DetailedRationaleForConstructs File
      Not available unless: Your ID number contains 02
    • CFIR - Figure and Explanatory Text File
      Not available unless: Your ID number contains 02
    • CFIR-MatrixOfConstructs File
      Not available unless: Your ID number contains 02
    • CFIR-ShortDefinitions File
      Not available unless: Your ID number contains 02
    • re-aim framework constructs checklist File
      Not available unless: Your ID number contains 02
    • REAIM Review Gaglio 2013 File
      Not available unless: Your ID number contains 02
    • English Kenya CFIR File
      Not available unless: Your ID number contains 02

    • Optional Reading:

    • Schillinger D, Hammer H, Wang F, Palacios J, McLean I, Tang A, Youmans S, Handley M. Seeing in 3-D: examining the reach of diabetes self-management support strategies in a public health care system. Health Educ Behav. 2008 Oct;35(5):664-82. Epub 2007 May File
      Not available unless: Your ID number contains 02

  • Thursday, October 23, 2014; 8:45 AM - 10:15 AM

    Lecture: Overview of Evaluation Methods/Implementing the Evaluation/Dissemination - think about it before you design methods

    Faculty:  Janet Myers

    Location:  Mission Hall 1108

    • Prospectus:

    • Session 6 One Page Overview File

    • Session Slides:

    • Evaluation Methods Lecture 10 31 13 File

    • Required Reading:

      1. Weiss, Carol.  Evaluation:                                                                                                                          
        1. Chapter 7, “Collecting data”
        2. Chapter 9, “The Randomized Experiment”
        3. Chapter 11, “Qualitative Methods”
        4. Chapter 12, “Analyzing and Interpreting Data”
      2. Identifying Collecting Evaluation Data: An Overview of Sources and Methods (available at: http://learningstore.uwex.edu/Assets/pdfs/G3658-04.pdf)

    • Optional Reading:

    • data collection toolkit File
      Not available unless: Your ID number contains 02
    • Handley - Quasi-experimental design in practice-based settings File
      Not available unless: Your ID number contains 02
    • Meissner-SPR-Mixed Methods File
      Not available unless: Your ID number contains 02
    • Michie - Behavioral change wheel File
      Not available unless: Your ID number contains 02
    • Plano-Clark-SPR-Mixed Methods File
      Not available unless: Your ID number contains 02
    • Collecting Evaluation Data File
      Not available unless: Your ID number contains 02
    • Creswell - Mixed methods in primary care File
      Not available unless: Your ID number contains 02
    • Creswell- Designing and Conducting Mixed Methods Research Chapter 4 File
      Not available unless: Your ID number contains 02

  • Thursday, October 30, 2014; 8:45 AM - 10:15 AM

    Lecture: Qualitative Methods in Evaluation

     

    Faculty:  Kimberly Koester

    Location:      Mission Hall 1108

    • Required Reading:

    • A guide to quant analysis GAO File
      Not available unless: Your ID number contains 02
    • How to represent qual data File
      Not available unless: Your ID number contains 02
    • Survey Guide File
      Not available unless: Your ID number contains 02
    • Quick reference guide: Activities requiring or not requiring CHR review and approval prior to initiation. URL

  • Thursday, November 6, 2014; 8:45 AM - 10:15 AM

    Lecture: Multi-level Interventions and Measurement

    Faculty:  Kang Dufour

    Location:      Mission Hall 1108

    • Session Audio/Video Recording (Access restricted to registered students):

  • Thursday, November 13, 2014; 8:45 AM - 10:15 AM

    Lecture: A case of community-level program evaluation: Evaluating Patient Centered Medical Homes

     

    Faculty:  Reena Gupta

    Location:      Mission Hall 1108

  • Thursday, November 20, 2014; 8:45 AM - 10:15 AM

    Lecture: Evaluation in the Global Context

    1. Identify outcomes that can be appropriately attributed to the program; 2. Choosing an evaluation design; 3. Selecting methods to answer the research questions.

    Faculty:  Lambdin

    Location:      China Basin 1108

    • Rugg et al File
      Not available unless: Your ID number contains 02
    • Patton File
      Not available unless: Your ID number contains 02
    • 1471-2458-10-447 File
      Not available unless: Your ID number contains 02
    • Beyond Indicators Advances in Global HIV.11[1] File
      Not available unless: Your ID number contains 02

  • Thursday, November 27, 2014; Thanksgiving - No Class

     

  • Thursday, December 4, 2014; 8:45 AM - 10:15 AM

    Lecture: Wrap Up

    Faculty:  Janet Myers

    Location:      Mission Hall 1108