Syllabus

Course Information

Marxe School of Public and International Affairs

Course Name: PAF 9174 (43225), Program Evaluation

Instructor: Gang He and Samantha Macbride

Email: and

Time: Saturday 12:30-3:30pm

Location: Newman Vertical Campus, 14th Floor, Room 14-285

Course Description

This course examines the practical aspects of program evaluation within public policy in domestic and international contexts. Emphasis is placed on the design and implementation of small- to medium-scale program evaluations under time and budget constraints using ‘best feasible’ methods. Topics include the types and purposes of evaluation, theory-based evaluation, evaluability and planning, measurement and construct validity, data collection, evaluation design, estimation of program effects, experiments, qualitative and mixed methods, evaluation resistance, building organizational capacity, ethics, cost-effectiveness, and reporting and utilization. The course will be useful to students working in a variety of mission-driven organizations, especially those who currently have, or expect to have in the future, program evaluation responsibilities.

Learning Objectives

  • Develop and conduct practical program evaluations under time and budget constraints using the best feasible methods
  • Understand the various types and purposes of evaluation and the specific role of impact evaluation within the broader evaluation field
  • Determine whether specific programs are evaluable
  • Critique program evaluation designs based on principles of internal and external validity
  • Create a logic model in support of theory-based evaluation
  • Define desirable program outcomes in measurable terms
  • Evaluate the costs and benefits of various methods for data collection and analysis
  • Employ specific quantitative and qualitative methods to support program evaluation, including the estimation of program effects
  • Understand evaluation jargon and understand key nuances in evaluation discourse
  • Anticipate and address common sources of resistance to evaluation
  • Exhibit an awareness of program evaluation capacity in organizations, articulate the major obstacles to evaluation, and identify opportunities for improving evaluation capacity and practice.

Class Readings

Required text, available online via Baruch Newman Library.

  • Newcomer, Kathryn E., Harry P. Hatry, and Joseph S. Wholey. 2015. Handbook of Practical Program Evaluation. Fourth ed. San Francisco, CA: Jossey-Bass. [Hereafter, “Handbook”].
  • Other readings and materials will be posted on Blackboard.

Grading

Final grades will be calculated as follows:

Item Weight Notes
Weekly case study 40 % 5 cases
Project: Proposal 10 %
Project: Presentation 20 %
Project: Final report 30 %

Grading Scale

Grade Range Grade Range
A 93 - 100% C 73 - 76.99%
A- 90 - 92.99% C- 70 - 72.99%
B+ 87 - 89.99% D+ 67 - 69.99%
B 83 - 86.99% D 63 - 66.99%
B- 80 - 82.99% D- 60 - 62.99%
C+ 77 - 79.99% F < 60%