National Academies Press: OpenBook
« Previous: References
Suggested Citation:"Appendix A: Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2017. Principles and Practices for Federal Program Evaluation: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/24831.
×

Appendix A

Workshop Agenda

Principles and Practices for Federal Program Evaluation

October 27, 2016
Keck Center of the National Academies of Sciences, Engineering, and Medicine
500 Fifth Street, NW, Washington, DC
Room 100

Thursday, October 27, 2016
Open Session, 9:00am–4:30pm

9:00am Call to Order
Breakfast available outside the meeting room
Welcome and Introduction
Connie Citro, Director, Committee on National Statistics
Christine Fortunato, Administration for Children and Families
Purpose of the Workshop
Russ Whitehurst, Brookings Institution, Committee Chair
The steering committee for the workshop will facilitate discussion on principles and practices for federal program evaluation, to include reviews of extant policies issued by the Administration for Children and Families, the Institute for Education Sciences, the Chief Evaluation Office in the Department of Labor, and other federal agencies. Throughout the workshop we will consider ways to build upon these documents, including ways to institutionalize the principles, with the goal of bolstering the integrity and protecting the objectivity of the evaluation function in federal agencies, which is essential for evidence-based policy making.
Suggested Citation:"Appendix A: Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2017. Principles and Practices for Federal Program Evaluation: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/24831.
×
Scope of the Workshop:Evaluations of interventions, programs, and practices intended to affect human behavior, carried out by the federal government or its contractual agents, domestic and abroad, and leading to public reports sponsored by the federal government that are intended to provide information on their impacts, cost, and implementation.
9:20am History of Federal Program Evaluation
Moderator: Howard Rolston, Abt Associates (Committee Member)
Discussants: Jean Grossman, Princeton University; Ron Haskins, Brookings Institution; Larry Orr, Johns Hopkins University
History of federal program evaluation and its successes, challenges, and vicissitudes from a variety of perspectives, including formal federal government evaluation leaders, evidence-based policy advocates, and social policy researchers and producers.
10:20am Break
10:35am Review of Present Principles by Topic and Agency Coverage
Moderator: Brian Harris-Kojetin, CNSTAT Deputy Director
Discussants: Naomi Goldstein Administration for Children and Families (ACF); Jack Molyneaux, Millenium Challenge Corporation (MCC); Ruth Neild, Institute of Education Sciences (IES); Demetra Nightingale, Department of Labor (DOL)
Exploration of several prominent evaluation agencies and their approaches to protecting the integrity and objectivity of evaluation work through formal guidance and other means.
11:30am What More Do We Need to Understand/What’s Missing from Current Evaluation Principles & Practices: A Discussion
Moderator: Russ Whitehurst, Brookings Institution (Committee Chair)
Suggested Citation:"Appendix A: Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2017. Principles and Practices for Federal Program Evaluation: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/24831.
×
(For discussion panels, each moderator will open the session with initial remarks that will lay out a coherent framework for the task and issues at hand. The steering committee members will offer their opinions, and then attendees will have an opportunity to share their thoughts and insight. We encourage active audience participation during these sections.)
12:00pm Lunch
1:00pm Issues and Challenges for Implementing Principles & Practices: A Discussion
Moderator: Judy Gueron, MDRC President Emerita (Committee Member)
Although the five principles in current agency guidance—rigor, relevance, transparency, independence, and ethics—seem uncontestable, challenges arise in balancing them, especially since advancing high-quality evaluations requires both obtaining sustained funding and engaging the best talent. This discussion will focus on the components necessary to advance high-quality evaluations, protect the infrastructure that supports them, and ensure that the evaluations produce results that a broad community of politicians, practitioners, and funders consider objective and useful.
2:00pm How Do We Institutionalize the Major Principles? (Discussion)
Moderator: Bill Sabol, Westat (Committee Member)
Discussant: Bethanne Barnes (OMB)
Even with broad support for enhancing the principles outlined in the previous discussion—quality, utility, transparency, independence, and high ethical standards—these goals cannot be achieved by the efforts of evaluation staff alone. Rather, these principles need to be institutionalized into agency practices so that evaluators are protected against efforts to quash them. Similarly, ensuring an adequate funding base for evaluations requires agency-level commitments to developing knowledge both about what works and the circumstances under which something works or does not work. Institutionalizing these principles may require legislative changes to statutory authorities, new organizational entities, or new
Suggested Citation:"Appendix A: Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2017. Principles and Practices for Federal Program Evaluation: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/24831.
×
relationships between organizations. This discussion will focus on approaches that can be taken to institutionalize quality, relevance, and independence, the opportunities and challenges associated with various approaches, and pathways and priorities to implement the changes.
2:45pm Break
3:00pm Garnering Support and Maintaining Focus: A Discussion
Moderator: Rebecca Maynard, University of Pennsylvania (Committee Member)
Discussant: Jon Baron, Arnold Foundation
Discussion will center on how to develop guidance that will directly serve the interests of evaluation offices within federal agencies while simultaneously mitigating the potential resistance from offices and organizations whose interests may be threatened by the formation of such a document (e.g., advocacy organizations and special interest groups). The discussion will consider vehicles and resources that can maximize support for objective evaluation across federal, state, and local levels of government, including executive and legislative branches.
4:00pm Future of Principles & Practices for Federal Program Evaluation: A Discussion about Next Steps
Moderator: Russ Whitehurst, Brookings Institution (Committee Chair)
This concluding session will focus on themes from the preceding sessions and consider potential future steps for articulating and strengthening principles and practices for federal program evaluation and the evaluation function itself.
4:30pm Adjourn
Suggested Citation:"Appendix A: Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2017. Principles and Practices for Federal Program Evaluation: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/24831.
×
Page 45
Suggested Citation:"Appendix A: Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2017. Principles and Practices for Federal Program Evaluation: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/24831.
×
Page 46
Suggested Citation:"Appendix A: Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2017. Principles and Practices for Federal Program Evaluation: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/24831.
×
Page 47
Suggested Citation:"Appendix A: Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2017. Principles and Practices for Federal Program Evaluation: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/24831.
×
Page 48
Next: Appendix B: Biographical Sketches of Steering Committee Members and Speakers »
Principles and Practices for Federal Program Evaluation: Proceedings of a Workshop Get This Book
×
Buy Paperback | $50.00 Buy Ebook | $40.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

In October 2016, the National Academies of Sciences, Engineering, and Medicine convened a 1-day public workshop on Principles and Practices for Federal Program Evaluation. The workshop was organized to consider ways to bolster the integrity and protect the objectivity of the evaluation function in federal agencies—a process that is essential for evidence-based policy making. This publication summarizes the presentations and discussions from the workshop.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!