Design Considerations for Evaluating the Impact of PEPFAR: Workshop Summary (2008)

Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Appendix A Agenda Design Considerations for Evaluating the Impact of PEPFAR Monday, April 30–Tuesday, May 1, 2007 Institute of Medicine Keck Building, 500 Fifth Street, N.W., Room 100, Washington, DC Purpose: To discuss methodological, policy, and practical design consider- ations from the three main perspectives on accountability: • “Upward”—Congress • “Horizontal”—Global Partners/Coordination • “Downward”—Country Partners/Harmonization The workshop was moderated by Ruth Levine, director of programs and senior fellow, Center for Global Development. Portions of the workshop were webcast thanks to the Kaiser Family Foundation and are available at http://www.kaisernetwork.org/healthcast/ iom/30apr07. Monday, April 30, 2007: Perspectives on Evaluation 9:00–9:10 a.m.  Welcome Michele Orza, ScD Study Director, PEPFAR Implementation Evaluation Institute of Medicine (IOM) 111 

112 EVALUATING THE IMPACT OF PEPFAR 9:10–9:15 a.m.  Introduction and Framing the Issues Ruth Levine, PhD Director of Programs and Senior Fellow Center for Global Development  9:15–10:15 a.m.  Congressional Perspective Purpose: To understand what Congress wants and needs to learn from impact evaluation; to discuss the evaluation language in The Leadership Act. Savannah Lengsfelder, MA  Legislative Assistant U.S. Senate Committee on Foreign Relations, Subcommittee on African Affairs Christos Tsentas Senior Legislative Assistant Office of Representative Barbara Lee David Gootnick, MD Director, International Affairs and Trade U.S. Government Accountability Office Allen Moore, MBA Senior Fellow, Global Health Council Senior Associate, Center for Strategic and International Studies Jim Sherry, MD, PhD (Discussant) Subcommittee Member, IOM Committee for the Evaluation of PEPFAR Implementation Professor and Chair, Department of Global Health George Washington University 10:15–11:15 a.m.  PEPFAR Perspective Purpose: To understand the U.S. Global AIDS Coordinator’s overall strat- egy for monitoring and evaluation, how impact evaluation fits into it, what program officials need and want to learn from impact evaluation, how they plan to coordinate and harmonize. 

APPENDIX A 113 Tom Kenyon, MD, MPH Principal Deputy U.S. Global AIDS Coordinator, Chief Medical Officer Office of the U.S. Global AIDS Coordinator Kathy Marconi, PhD, MS Director of Monitoring, Evaluation, and Strategic Information Office of the U.S. Global AIDS Coordinator Shannon Hader, MD Senior Scientific Advisor Office of the U.S. Global AIDS Coordinator 11:15–11:30 a.m.  Break 11:30 a.m.–1:00 p.m.  Perspectives of Global Partners Purpose: To learn the perspective of other donors with whom the United States should be coordinating with respect to monitoring and evaluation. Paul R. De Lay, MD Director, Monitoring and Evaluation Joint United Nations Programme on HIV/AIDS Jody Kusek, PhD Lead Monitoring and Evaluation Specialist, Global HIV/AIDS Program World Bank Julia Compton, PhD Senior Evaluation Manager, Evaluation Department UK Department for International Development Ambassador Jimmy Kolker (Discussant) Deputy U.S. Global AIDS Coordinator Office of the U.S. Global AIDS Coordinator Jim Sherry, MD, PhD (Discussant) Subcommittee Member, IOM Committee for the Evaluation of PEPFAR Implementation Professor and Chair, Department of Global Health George Washington University 1:00–1:30 p.m.  Lunch Break 

114 EVALUATING THE IMPACT OF PEPFAR 1:30–2:15 p.m.  Luncheon Speaker and Discussion “Monitoring and Evaluating Fairness in Scaling-Up ART” Norman Daniels, PhD Professor of Ethics and Population Health Harvard School of Public Health 2:15–4:15 p.m.  Perspectives of Implementers and Country Partners Purpose: To learn the perspective of various partners and stakeholders in the impact evaluation—the focus countries, program implementers, other programs with which the United States should be harmonized with respect to monitoring and evaluation, advocacy groups. Agnes Binagwaho, MD Executive Secretary Rwanda National AIDS Control Commission Jonathan Mwiindi Director, Kijabe HIV/AIDS Relief Program, Kenya HIV/AIDS Program Officer Ecumenical Pharmaceutical Network Nils Daulaire, MD, MPH President and Chief Executive Officer Global Health Council Mary Lyn Field-Nguer, MSN, FNP Director, Global HIV/AIDS Programs/Washington John Snow, Inc. Kent Glenzer, PhD Director, Impact Measurement and Learning Team CARE USA Sara Pacqué-Margolis, MPH Director, Monitoring and Evaluation Elizabeth Glaser Pediatric AIDS Foundation 4:15–4:30 p.m.  Break 

APPENDIX A 115 4:30–5:45 p.m.  Combined Panel Moderated discussion with all panelists and audience. Tuesday, May 1, 2007: Evaluation Design Challenges and Solutions Purpose: To benefit from the experience of people who have evaluated or are currently evaluating programs that have major elements in common with the U.S. Global AIDS Initiative.  9:00–11:00 a.m.   esign Lessons Learned from Evaluating Donor Programs D (Macro-, Meso-, Micro-Level) Phillip Nieburg, MD, MPH (Moderator/Discussant) Senior Associate and Co-Chair Prevention Committee, HIV/AIDS Task Force Center for Strategic and International Studies Jaime Sepúlveda, MD, DrSc Chair, IOM Committee for the Evaluation of PEPFAR Implementation Visiting Professor and 2007 Presidential Chair University of California–San Francisco Martha Ainsworth, PhD Lead Economist and Coordinator Health and Education Evaluation Independent Evaluation Group World Bank Rachel Glennerster, PhD Executive Director Abdul Latif Jameel Poverty Action Laboratory Julia Compton, PhD Senior Evaluation Manager, Evaluation Department UK Department for International Development Kent Glenzer, PhD Director, Impact Measurement and Learning Team CARE USA 

116 EVALUATING THE IMPACT OF PEPFAR Stefano Bertozzi, MD, PhD Member, IOM Committee for the Evaluation of PEPFAR Implementation Member, The Technical Evaluation Reference Group–The Global Fund Director, Division of Health Economics and Policy National Institute of Public Health, Mexico Jim Sherry, MD, PhD (Discussant) Subcommittee Member, IOM Committee for the Evaluation of PEPFAR Implementation Professor and Chair, Department of Global Health School of Public Health and Health Services George Washington University 11:00–11:15 a.m.  Break 11:15 a.m.–1:15 p.m.  Methodological Challenges (Meso-, Micro-Level) Purpose: To discuss critical methodological issues and approaches for ad- dressing them. Focus: Evaluation of key AIDS-specific outcomes and impacts. Paul R. De Lay, MD Director, Monitoring and Evaluation Joint United Nations Programme on HIV/AIDS Theresa Diaz, MD, MPH Branch Chief, Epidemiology and Strategic Information Global AIDS Program, U.S. Centers for Disease Control and Prevention Geoff Garnett, PhD Member, IOM Committee for the Evaluation of PEPFAR Implementation Professor of Microparasite Epidemiology Imperial College William L. Holzemer, RN, PhD, FAAN Member, IOM Committee for the Evaluation of PEPFAR Implementation Professor and Associate Dean, International Programs, School of Nursing University of California–San Francisco Rand Stoneburner, MD, MPH Independent Consultant 

APPENDIX A 117 Agnes Binagwaho, MD (Discussant) Executive Secretary Rwanda National AIDS Control Commission Timothy Fowler, MA (Discussant) Chief, Health Studies Branch, International Programs U.S. Bureau of the Census Rachel Glennerster, PhD Executive Director Abdul Latif Jameel Poverty Action Lab Caroline Ryan, MD, MPH (Discussant) Chief Technical Officer Office of the U.S. Global AIDS Coordinator 1:15–2:00 p.m.  Lunch Break 2:00–4:00 p.m.   ore Methodological Lessons/Challenges (Meso-, M Micro-Level) Purpose: To discuss critical methodological issues and approaches for ad- dressing them. Focus: Evaluation of key outcomes and impacts that are not AIDS specific. Stefano Bertozzi, MD, PhD Member, IOM Committee for the Evaluation of PEPFAR Implementation Director, Division of Health Economics and Policy National Institute of Public Health, Mexico William L. Holzemer, RN, PhD, FAAN Member, IOM Committee for the Evaluation of PEPFAR Implementation Professor and Associate Dean, International Programs, School of Nursing University of California–San Francisco Carl Latkin, MS, PhD Subcommittee Member, IOM Committee for the Evaluation of PEPFAR Implementation Professor, Department of Health Policy and Management Johns Hopkins School of Public Health 

118 EVALUATING THE IMPACT OF PEPFAR John Novak, PhD Senior Monitoring and Evaluation Advisor, Office of HIV/AIDS U.S. Agency for International Development Jessica E. Price, PhD Country Director, Rwanda Family Health International Julie Pulerwitz, ScD Research Director, Horizons Program Population Council, seconded from PATH Martha Ainsworth, PhD (Discussant) Lead Economist and Coordinator Health and Education Evaluation Independent Evaluation Group World Bank Mary Lyn Field-Nguer, MSN, FNP (Discussant) Director, Global HIV/AIDS Programs/Washington John Snow, Inc. Kent Glenzer, PhD (Discussant) Director, Impact Measurement and Learning Team CARE USA Jonathan Mwiindi (Discussant) Director, Kijabe HIV/AIDS Relief Program, Kenya HIV/AIDS Program Officer Ecumenical Pharmaceutical Network Mead Over, PhD (Discussant) Senior Fellow Center for Global Development 4:00–4:15 p.m.  Break 4:15–5:45 p.m.  Combined Panel Moderated discussion with all panelists and audience. Summary of key issues and the way forward.